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Thirtieth Anniversary 


Thirty vears ago this month THe BELL System TECHNICAL JOURNAL 
began publication. Suggested by Dr. George A. Campbell, it had been 
under discussion for some years. Dr: R. W. King, who had been one 
of its most active advocates, became its editor when the staff of the 
JOURNAL was established. Except for a six-year period following 1928, 
while he was in England, Dr. King continued as editor until he retired 
in 1949, 

By July, 1922, when No. 1, Vol. 1 of the JourNAL appeared, research 
and development was a long established practice in the Bell System. 
The high-vacuum electronic tube, which had already begun to revolu 
tionize electrical communication, was itself a product of Bell System 
research, Since electrical communication was a still comparatively new 
field of study, however, its publications were widely scattered. There 
seemed a need for a magazine that would serve the communication 
engineers exclusively, and it was largely to meet this need that THe BELL 
SysTeM TECHNICAL JOURNAL Was launched. 

In the thirty vears since that time, the art and science of communica 
tion has advanced and ramified beyond anything likely to have been 
then foreseen. A very substantial part of this increase has originated 
within the Bell System, and this progress has been reflected in the pages 
of the TECHNICAL JOURNAL. There seems little reason to doubt that 
the next three decades will witness an advance at least comparable 
with that of the past three, and it is planned to have the JourNAL pre 
sent the work of the coming years, with perhaps even greater effective 
ness than inthe past. Abstracts or titles of all Bell System technical and 
scientific papers appearing in other publications are listed in the JouRNAL 
and reprints of many of these papers are available and may be obtained 
by subscribers. In one Wav or another, therefore, JouRNAL readers have 
access to essentially all the technical papers published by the Pell 
System. With this increased coverage, it is hoped that the JourNaA 
will prove increasingly useful to a growing circle of readers 
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Network Synthesis Using Tchebycheft 
Polvnomial Seriest 


By SIDNEY DARLINGTON 


Manuscript received April 17, 1952 


A (ye neral method is developed for finding functions of frequency which 
approximate assigned gain or phase characteristics, within the special class 
of functions which can be realized exactly as. the gain or phase of finite 
networks of linear lumped elements. The method is based upon manipula- 
tions of two Tchebycheff polynomial series, one of which represents the 
assigned characteristic, and the other the approximating network function. 


The wide range of applicability is illustrated with a number of example 2. 


L. INTRODUCTION 


Network synthesis is the opposite of network analysis namely, the 
design of a network to have assigned characteristics, us opposed to the 
evaluation of the characteristics of an assigned network. In general, 
there are specifications on the internal constitution of the network, as 
well as requirements relating to its external performance. A common 
form of the general problem is the design of a finite network of linear 
lumped elements, to produce an assigned gain or phase characteristic 
over a prescribed interval of useful frequencies. The present paper re 
lates to this particular form. 

In general, the restrictions on the network are such that the assigned 
performance cannot be matched exactly. This gives rise to an approx! 
mation or interpolation problem. For present purposes, the problem is: 
to choose a function of frequency which matches the assigned gain or 
phase to a satisfactory accuracy, Irom that special class of functions 
which can be realized exactly with physical finite networks of linear 
lumped elements. The function of frequency may be defined in terms 


of network singularities (natural modes and infinite loss points). The 

+ Presented orally, in briefer form, at the 1951 Western Convention of the 
Institute of Radio Engineers, and at the Symposium on Modern Network Syn- 
thesis sponsored by the Polytechnic Institute of Brooklyn and The Office of 


Naval Research, New York City, April, 1952 
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Interpolation problem may then be regarded as solved when a suitable 
set of network singularities has been obtained; for quite different tech- 


niques are used to design actual networks with these singularities. 


Phe interpolation problem may be attacked in a number of different 


vavs; and a variety of different techniques ure, in fact, needed to cover 
the wide diversity of practical applications The present topie 1s a fairly 
general way of attacking the problem, based upon manipulations of two 
ries of Pohebyvcheff pols nomials. The two series represent expansions 
vO Tunetions of tTrequency one, the ideal assigned Pull OF phase, 

i other, the network approximation to the ideal. The interpolation 
problem may be solved in this way because it is feasible, as will be 
to determine network singularities from arbitrarily assigned 

of coefficients in the corresponding Tchebycheff polynomial series. 

The techniques to he dese ribed were derived originally trom studies 

of the so-called pote nitial analogy . but they can now be developed most 
easily without reference thereto.T In a sense they may be regarded as 
extensions of familiar filter theory, using Tchebvcheff polynomials, to 
more general gain and phase functions. The extensions, however, depend 
upon a number of new principles. Extensions of the filter theory applied 
to more general problems have heen noted 1h published papers ; but 
those noted have not used the specific general approach employed here. 
Phe wide applicability of this general approach will be illustrated by 


Spe C ea imples 


PWORK AND TRANSMISSION FUNCTION 


Il be sufficient for our present purposes to limit the discussion to 

neral 4-pole shown in Fig. 1. The 4-pole may be active or passive, 

but it must be a stable finite network of linear lumped elements. / and 

Vo are steady state ac voltages, i the driving voltage and V the response. 

Phe gain a and phase 3 are here defined as the real and imaginary parts 
l 


fe network of hin ped eleme hts, @ + Ww alwavs has the fol 


res on el 


Method of 





NETWORK SYNTHESIS O15 


The “frequency variable’? p represents, of course, iw. The zeros p, of 
the rational fraction are those values of p at which there is infinite loss. 
The poles p,; are the so-called natural modes, or values of p at which 
response V can exist in the absence of driving voltage -. The seale 
factor A determines the average level of transmission. The zeros, poles, 
and scale factor together determine the gain and phase completely. 

For a physical stable network, the zeros and poles must meet certain 
well known restrictions, which are commonly stated in terms of loca- 
tions in the complex plane for frequency variable Pp. Within these re- 
strictions, the zeros and poles can be subject to arbitrary choice, say 


for purposes of network synthesis. 


Ets: 
| 
a+ iB=.oc6 V/E 
Fig ] \ general } pole 


The symmetries required by the physical restrictions permit a and 3 


to be represented separately as follows:7 


119 


2a = log = 


nm = p)(ps” me ey 
123 log \P1 : Pp) ately (pr T P) 
(pi + p)-+: (mn — p) 
These expressions hold at all real frequencies, but 
| | 


quencies, 


3. TCHEBYCHEFF POLYNOMIALS 


It is functions of these special types which we are to synthesize with 
the help of Tchebycheff polynomials. More generally, Tchebycheff 
polynomials come in various forms, and may be analyzed in various 
Ways. Kor our special purposes, however, they take somewhat special 
forms (a little different from textbook definitions); and they are best 
analyzed in quite special ways.t It will be simplest to start with arbi- 
trary definitions, to be justified later on by demonstrations of usefulness 


+ The phase equation omits a possible 180° phase reversal, which 
present purposes 

t For discussions of Tchebycheft polynomials from other 
Courant and Hilbert®, and also a paper b Lanczos® on trigonom 


tion 
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the definitions must vary with the nature of the useful fre- 
il. For the present, however, it vill be “assumed that the 


W@W, , OF 


il extends from more precisely, from 
with the symmetries of gain and phase 
als which do not include w 


tions, Which wal 


‘) + ' Iti accordance 
| setul ritery () require changes 
| be taken up in Section 2S 


present 


Purposes, Pchebveh 


eff polynomials 7. may be defined 


(tiation defines angle variable, @m, lh terms of 


Hnawinarv scuie 


an nuNiary 
especially simple Phe 


factor 7, associated 
jomiuals of odd order. 


simplifies later analysis. In addition, it 
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is especially appropriate for general network applications, because the 
odd ordered polynomials contribute to the imaginary parts of complex 
network functions—such as 73 in a + tb.t 

It is apparent from (3) that the Tchebycheff polynomials become 
simply Fourier harmonics, if they are plotted against a distorted tre- 
quency scale—that is, against @. This means that they must be ortho- 
gonal, over that particular range of frequencies which corresponds to 
real values of @. From the relation between @ and w, it is clear that real 
values of @ cover the frequency interval between —a, and +w, , which 
is our useful interval. In other words, the interval of orthogonality coin 
cides with the useful frequency interval. The corresponding interval of 
Pp is of course p = —lw, to +tw 

If a given function is plotted against ¢, instead of w, it may be ex- 
panded in a Fourier series. Each term in the series may be replaced by 
a Tchebycheff polynomial, to obtain an expansion of a given function 
in terms of polynomials, for the specific useful interval w w. to 
+w,. Established techniques are available for expanding experimental, 
or other numerical data, in Fourier series, as well as actual analytic 
functions. 
In Fig. 2, some of the Tchebycheff polynomials are plotted against w 


The frequencies —w, and +, are also indicated. Frequencies between 










these limits correspond to real values of the angle variable @. If this 
part of the frequency scale is stretched, in the proper non-uniform way, 
the various “‘loops’”’ not only have the same maximum values, but also 
the same shapes. In other words, they become periodic. More specifically, 
a stretch which changes the frequency scale into a @ scale changes the 


plots into sin k@ or cos k@. 









!. TRANSFORMATION OF VARIABLE 


An alternate to (3) may be obtained by relating a new variable, z, to 
o by 
h, 


Substituting z in the exponential equivalent of sin @, in the first equa- 








tion of (3), gives an alternative definition of z directly in terms of p, 
namely : 


r-3(-3) , 


+ A small change in the definition of @ would bring the definitions closer to 
convention, by replacing both sines by cosines (without altering 7 


is a function 
of p This however, would complicate our later analysis 
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ential the other sine and cosine 


1), BoM 


ipplications depend upon the nature of the relationship be- 
variable The relationship is illustrated 
sponding COnTOUrS In the p and 2 planes. 


nterval, z, as defined by (4), has 


irnable P, and the 
vhich indicates corre 
ngle @ is real in the useful i 
tude. In equivalent conformal mapping terms, the unit circle 
maps onto a segment of the axis of real frequencies in 
numely the segment extending from p ¢ 
that the useful interval in the z plane is 
ntervals outside the 


lw, tO +*-lw 


shall say merely 
, 1. The real frequeney 
lin il map onto the imaginary axis in the z-plane. 
me cireles with radi other than unity map onto p-plane ellipses, all 


pl 
Phis is reminiscent of filter theory using Tcheby- 


vith toel | p 
chet] poly omials, and in fact such a filter may be obtained by spacing 


plane mappings of natural modes uniformly around such a circle.t 








lhe complex planes for p and z. 


loped in detail in a monograph by Wheeler’, which 


liogray hy 
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2). Z-PLANE MAPPINGS OF NETWORK SINGULARITIES 


2-plane mappings of network singularities are also an essential part 


of synthesis applications. The mapping Zz, of a typical zero or pole Po Is 


illustrated in Fig. 4. From (5), the analytic relation must be: 


wef. | ) 
2 (=. Be 

By its quadratic nature, there must be exactly fivo values of z, , corre- 
sponding to one p,. The relation is such that replacing z, by | 
leaves p, unchanged; and hence the two values of z, must be negative 
reciprocals, each of the other. Thus, one mapping of p, falls outside the 
unit 2-plane circle, and the other inside. 

A unique definition of z, may be obtained by requiring that z, must 
be the mapping outside the unit circle. Then | 2, > 1 by definition, and 
the complete definition of z, may be: 


This definition is unique provided network singularities p, are excluded 
from that very special line segment of the real frequency axis which 
corresponds to the useful frequency interval, —w. < wo < +w, (where 
| 2¢ | would be exactly 1) 

We are going to solve the interpolation problem by choosing the z, 
first, instead of the p-plane singularities p, , after formulating the inter- 
polation problem in suitable z-plane terms. For this, however, we must 

















fHE BELL SYSTEM TECHNICAL JOURNAL, JULY 1952 


t further conditions must be imposed upon the z, , so that 
yonding p will meet the special conditions necessary tor 


networks. A simple analysis of the definition (8) of z, , and of 


now restrictions o1 the De ; leads to the following assertion: 


7 hie ph jsical restriclions on Z, are 
exactly the same as those on p 
lis, Tor example that conjugate complex 


lor conjugate complex Peo - \lso, because 2 >, 
Phen the 


are necessary 
>, dominates l 
Sigh ol Re Po Is the same as that of the Re z 


,, and Po with 
vative real parts require 


with negative real parts, and so on. 
Thus the direct choice of is restricted in exactly the same Way as 
»ehoree of p 
The last condition imposes no important restriction on the corresponding 
Initially, it was adopted to make 


,except for the additional general requirement = z,) > 1. 


> 


unique for any p, (not at a 
real Prequeney but this condition does also play an essential 
the 2-plane formulation of the interpolation problem, 


NETWORK GAIN AND PHASE IN TERMS OF 


\ first step in the 2-plane formulation of the interpolation problem is 


the formulation of the network gain and phase functions, (1 
terms ol 


and (2 , in 
his is most usefully examined as a transformation of funce- 
orm rather than as a contormal mapping. 


rain and phase function (1) transforms as follows: The analytic 


between p and z is regular in the neighborhood of the singular- 
the network function. Therefore, there will be similar singu- 
transformed function at the 


| 


plane mappings of p, , 
Phese singularities, and also suitable behavior 


hibited by the following expression for a 13 as a 
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° ‘ ‘ ‘ ail -2 ‘ 
If we define a new scale factor K, by K, = Kz, we may write (9 


(1-4), 
; Ze Same Rational 
a+2i73= log < RK. - (% . ve . j 
II (1 2 ) | Function in —1/z 
_ if | 


I 


follows: 


Similar expressions for the separate gain and phase functions may be 


derived from (2): 


2\ \ 
a ae 
-2 20° Same Rational 
log 4K ee ee 
IT (1 - “m)) \ unction in —1/z 
:)} 


Ze 
(a ; 
Same Rational 


Function in —1/z 


Equation (13) holds at all values of p and z, while (14) holds at all 
(14) should be noted, good for the 


] 


real frequencies. Simplifications of 
10g 


useful interval only. When | z| = 1, l/z = 2*. Recalling also that 
| x | is 2 log | x |, and similar elementary relations, one obtains from (14 


Whe n g = i 


n(\-2) 


log K; (1 = 


Comparison with (5) and 


(1 - 


Thus (9) is equivalent to provided 
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SIS depend Upolu correspondence 
z and certain 


svinithe 
between certain functions of 
The functions of z may be formulated in terms of 
may be derived from the 


‘ 
ee 


gularities 


The power series in 
polynomial series In p representing the corresponding gain 


omial expansion of a gain and phase function 


1. 
MING} 


* or 16) 


a 


nite network, it may be represented by the 


mre sponds toanh 
in (135 At the same time, 7 


in (6). With these changes, (16 


may be represented by the 


becomes: 


IT (1 =) {Same Rational 
II (: = | Function m 


rithm of the product of the two rational functions, in and 


pectively, may be written as the sum of two logarithms. The 


ol and may be written as the sum of two series. 


Same Rational 


Function in 


in 


1 equates the sum of two similar functions, 
to the sum of two power series, also respectively 
theorem on which the svnthesis methods are based 
ons and power series In z and 1/zmay be equated 
useful interval. That is: 
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When 


II (1 - 
IT (1 


Same Rational 


log < K 


log ’ ‘ . 
Function in 

The relation (18) does not, by itself, require (19) to be true. (19) fol- 
lows from (18) if and only if the function of z has a power series expan- 
sion involving only positive powers of z, and the function in —1/z has 
& power series expansion in — 1,2, with the same coefficients. This added 
condition, however, is readily established for the useful interval. t 

Combining (19) and (16) vields a most useful relationship connecting 
the z-plane mappings z,, of the network singularities p,, and the 
coefficients C, , of the Tehebycheff polynomial expansion of @ + 78: 


a+tis= >) C,T 


IH(1- 5) 


>, 3C,2' log K 


In more qualitative terms: 


The transformation from variable p to variable 
converts an CL pansion th Tchebycheff polynomials 


in p into an expansion in @ power series in 


Thus, by working with the z,, in place of the p,, one may use a 
power series sort of analysis in calculating, or in choosing, the coeffi- 


cients C,, in the Tchebvcheft polynomial series. 


The relations (20) refer to the combined gain and phase function. 


\ 
Exactly similar relations can readily be obtained, however, for gain and 


+t As defined in (S), | 2 > 1. In the useful interval, | 2 1. Hence < | 
It follows that log | Z has a power! MacClauren series €xXpansion ih post 
tive powers of 2, convergent on and within the circle 1. Finally the first 
logarithm in (19) may be expressed as a sum of logarithms of this simple type, 


each of which may be expanded separately. Substituting 1/2 for maps the 
unit circle onto itself It follows that the second logarithm in (19) has 


s1On In positive 


in expan 
powers of 1/z, in the useful interval, provided the first loga 
rithm has an expansion in positive powers of z; and the coefficients in the two 


series will be the same 
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« 


These mav be derived from (14), and take the form: 


odd 


Phe absence of factors 5 in > ‘> as compared with (20), reflects the 


factors 2 associated with @ and 3 in (14 


S. REPRESENTATION OF ASSIGNED GAIN AND PHASE 


In synthesis problems, the network gain or phase, a or 9, 1s to ap- 


proximate an assigned (ideal) gain or phase, say a@ or 8. To make effee- 
tive use of the z-plane analysis, in network synthesis, we need to describe 
by relations analogous to (20) and (21), which express @ and 3 
Plane terms These relations, while similar to (20) and (21), must 
iL more general form (since & or 8 need only be approximately the 
isc of a finite network). For our present purposes, the ap- 
propriate re lations are those noted below 

Let & + 7p be any function of p which has the following properties: 
be analytic throughout the useful interval. Further, there are 
1 singularities within a p plane distance € of the useful interval, 
nite (but may be small). Finally, at real Frequencies, a@ and 

» equal respectively the even and odd parts Ol @ -+ 7p. 
conditions stated, @ + 78 may always be expanded In 
ehebyeheff polynomials 7, . Let > €.7, be the expansion 
i parallel to (20), we may form (arbitrarily) a power series 

we may define a function R(z) by identifying log R 


series. All this adds up to the following, comparable to 
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The functions of z have the following properties: Because of the mild 
restrictions, Which we have Imposed on the singularities of & + 7B, the 
series + defines a function which is analytic within, and on the 
circle 2 1. Then A(z), also, is analytic within, and on the circle. 
Further, 2(z) has no zeros anywhere in the same region. (2(z), however, 
mav be more general than the rational fraction in (20).) Finally, because 
of the even and odd symmetries, required ot & and 7p, (22 may be 


broken into the following parallels of the equations (21 


z. 'é 2 log R Z R 
R > / : odd 


= C Z lo - 
R g | 


u 


e 
| 
L 


In some applications, it is possible to express A(z) in closed form. In 
all applications, It is possible to expand R(z) asa power series, convergent 
in the region 2 > < 1. The same is true of 1/R(z), since there are no 
zeros in the region. Coefficients of either series (A(z) or 1 R(z)) may 
readily be calculated by means which we shall examine a little later. For 
the present we shall say merely that A(z) is a known function, corre 


sponding to an assigned & + 72, 


9. A DESIGN CRITERION 


) 


When the gain and phase function, a + 73, is to approximate @ 4 B, 
the error in the approximation is (a &) + 18 3). The error may 
he expressed in terms of 2 by taking the difference of corresponding 
equations in (20), (22). The difference of the logarithms may be ex- 
pressed as a single logarithm of a ratio. Alternatively, and also more 
conveniently for our later purposes, 1 may be expressed as the negative 


of the logarithm of the reciprocal ratio. When this is done, 


> rai C T; 


Consider the following arbitrary requirément, as a design criterion: 


The series ze T,. is to match exactly the series =e T, , through 
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terms of order m. If both series have converged to small remainders 
when / m, this criterion will surely make a@ + 73 a good approxima 


tion to & + i8.t In terms of the coefficients, the criterion requires: 


es I: << m 


If (25) is applied to the second equation of (24), the power series 1s 
zero through terms of order m. In other words, the logarithm, equated 
ies, Will approximate zero in the power series, or ‘maximally 

’ manner, to order m. The logarithm is zero when the expression in 
brackets is unl Further, the logarithm will approximate zero in the 
maximally flat manner when, and only when the bracket approximates 
unity in the maximally flat manner. Thus a condition which its equivalent 


5) is the following: 


Vhis mises bye represented symbolically by 


| I (: ) 


K (1 . 


where s used to indicate equality through power series terms of 


order 7 
When (27) 1s applied to network synthesis, the singularities z, , and 
scale factor A. are the unknowns, while R(z) is known. If m is equal to 
the total number of z, , (27) will determine the network function com- 
pletely. When m is smaller, (27) will furnish m + 1 relations between 
thre ietwork parameters including the zero orde r condition , which 
may be combined with specifications of other sorts. Since (27) is equis 
alent to (25 this procedure amounts to the determination of network 
parameters which will vield assigned values of the coefficients, C C 
m, in the Tehebvchefi polynomial expansion Ol a = 1p 
27) applies when both gain and phase are to be APPLrON 
For approximation to gain only, or to phase only, similar rela- 
smav be derived from (21) and (23). Only even ordered Tchebycheff 
the approximatio 
1 the error 


ol itiusat 





O77 
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polynomials contribute to gain. The following condition turns out to be 
the equivalent of Cy. = Cy ,k < m: 

| I (1- ga) 
“3 nd -R(z)R(—2z) 
kK P f 2" 
IT (1 - 
where = means approximation in accordance with 


order 2m. Correspondingly, only odd 
following 


a power series of 


even ordered terms, through 
ordered Tchebycheff polynomials contribute to phase. The 


condition is equivalent to Co, Cass k 1 to m: 


The remaining sections (except the last) develop in more detail the 
application of z-plane techniques to more specific synthesis problems, of 
various sorts. Most of these (but not quite all) are based directly on 
(27), (28), or (29). The exceptions use a modification of (28), in which 
the function of z on the left is retained, but with the zeros and poles 


me 


adjusted for a different kind of approximation to unity, & but not 


In all cases, unity is approximated with one of the functions appear- 
ing in (27), (28), (29). It will be convenient to use H(z) to represent the 


error in the approximation, or departure from unity. When gain only is 


of interest, the function in (28) is used, and H(z) is defined by: 


In developing the specific techniques, we shall start with a very 
definite, rather special example, in order to illustrate the techniques 
with specific operations. This will be discussed in considerable detail in 
Sections 10 through 14. Thereafter we shall examine how these specifi 


operations may be generalized, in a number of different respects. 


10. AN INTRODUCTORY EXAMPLE 


The example which has been chosen for detailed discussion is the 


equalization of the gain distortion produced by two resistance-capacity 
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equalization is to be accomplished with a network 


ral modes, but no finite frequencies of infinite loss. 


specications which define this 


be due to circuits or devices at two different 
communication svstem, which may be represented schemat- 
hig. 5. The etfect can be described in terms of two assigned 
lwo assigned modes are assumed, instead ol only one, 
mode would make the problem too simple. Our present 
served well, however, if we simplify the problem by 


vo assigned modes to be 7dentical, sav at p Pp 


~p 


iral modes would be cancelled completely by two infinite 
ame location in the p plane. A network with two 
however, is not physically possible unless it has also 

itural modes; and the natural modes will have to introduce 
own. Thus no finite network will give perfect equali- 
atural modes. Sometimes it is desirable, in practice, 

ualizer configuration which produces no finite frequencies Of 
the entire equalization being accomplished by a suitable 
modes, Configurations of this sort are illustrated In big. 
mple illustrative prot lem, though chosen to introduce 


il OOF some pring tien interes 


quencies of infinite loss simplifies the repre- 
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sentation of the network gain a. In (21 , the z correspond to finite tre 


quencies oF tifinite loss, and are to be omitted when there are to be 
natural modes only What is left is the logarithm of the reciprocal ota 
polynomial, which is of course the negative of the logarithm of the 
polynomial itself. Thus @ may be described as follows, for this particular 
application: 

Zz Cal 


2 a 3 log ATT (1 - : | Pe sen a 31) 


(For convenience, z. has been written for 2), and K. has been redefined 
to avoid the 1 A, required if it is defined as in (21 

The assigned gain & is even more special. In this particular problem, 
&@ has most of the properties of a network gain a. Specifically, it is the 
negative of the gain to be equalized, which in faet corresponds to a 
finite network. As a result, R(z) of (22) may be expressed in closed 
(rational) form. (Later on, we shall modify the methods appropriate for 
this very special situation, so that R(z) need be representable only by 
series, 

The specific representation of our present & may be very similar to 


the representation of @ in (31), as follows: 


a = bs C. Ty 
bs Co" - } log kK: (1 ae 4) 


(Both (31) and (32) apply only to the useful interval, - | 

The constant 3) is the z-plane mapping of the assigned unwanted 
natural modes at p = po, and may be calculated therefrom by (8). In 
(32), % determines the Cy , which in turn determine & The constants 
z,, in (31), are the z-plane mappings of the arbitrary natural modes of 
the equalizer. They are to be adjusted to make @ approximate &. Then 
the network natural modes p, may be calculated from them, by means 
of (8). 

Taking the difference of corresponding equations in (31) and 


gives the following, analogous to (24 


a-a= z (Cu — Cu)T x 
> (Co — Coe" = —log «K?R? ( - 3) II ( 


This differs from (24) in two regards. It relates to the gain error, (a 
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thout regard to phase. [t reflects the more specific functional forms of 
ta and &@ 

The formulas show that the coefficients in the Tchebvcheff poly 
nomial expansion Of our present a & are fixed by the logarithm of a 
polvnomial in 2, of degree n + 2. Since the TPehebycheff polynomial 
series is simply one representation of the function a &, this means 
that « v itself is determined by the polynomial in 2°. Out of the n + 2 

n terms of ,nmare subject to arbitrary choice, but the other two 
d to be at 2 55 
eat a useful choice of the zeros, one may start with the ex 
panded form of the polynomial, which replaces the second equation ol 


2*2 hy 
ow ’ 


Ss (¢ ( log 1Ky + Kir +--+: K 


—~ 


Al] but two ot the coefheients K may be assigned arbitrary values, pro 
vided the remaining two are then adjusted to give the required two 
zeros at 3,. The corresponding zeros 2, may then be found by 
ordinary root extraction methods 

Phe coeficients may be chosen in such a Way that the complex poly 
nomial approximates unity, when 1. Then the logarithm approx 
Imates zero, the coefficients in the power series (34) are small, and since 
these are also the coefficients in the TPehebyvcheff polynomial series im 


1] 
a@ is shail 


PCOHEBYCHEFF POLYNOMIAL SERIES MATCHED THROUGH 7 TERMS 


\ special choice of coctlicients, which meets these requirements fairly 
well, is the choice determined hy 28), with m n. The function on the 
28) is here the polynomial in (34). For our present purposes, 


28 hecomes: 


(Ao + Aiz+-+- Ruse} 35 


l.and K QO tor / lL ton. Then K,., and R, 19 


vive the two required Zeros at 2 Z. Lhis gives: 


whe Seiad 
49(EY7 ema n(2y oo 


ly iccordanee With Section 9 this special choice of coefhicients corre- 
sponds to a match of Pehebyvcheff polynomial series, a to &, through 


} i ae 
terms ob order Jn 


(37) 
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Fig. 7—Error when four natural modes equalize two natural modes at 
po = —0.750 

The actual accuracy may be calculated from the final zeros and poles, 
from non-zero terms in the expansion of a — &, or by an analysis in 
terms of z which will be described later. 

A sample plot of @ — & is shown in Fig. 7. This corresponds to an 
equalizer of four natural modes, compensating for an initial loss which 
rises to about 8 db at the top useful frequency, or a distortion of +4 db 
about the median loss. Residual errors are order of +0.06 db. 

A little later we shall return to the question of accuracy, to take up 
methods of estimating what can be done with other numbers of arbi- 
trary natural modes, and other values of the assigned modes. First, 
however, we should investigate whether the network singularities z, 
determined by (36) meet the other necessary conditions. 


12. PROPERTIES OF Z, 


In the first place, | 2,| must be >1. Otherwise, the function of z in 
(31) will have no power series expansion over the useful interval  z|) = 1; 
and (31) will not, in fact, determine the gain @ over the useful interval. 
It turns out, however, that the condition does not give trouble in the 


synthesis of natural modes, when there are no arbitrary frequencies of 


infinite loss. This may be demonstrated by the argument outlined below. 
The z, are zeros of the polynomial in (34), which we have given the 
special form (36), by applying (35). A function theoretic test for | z, | < 1 








PH BELL SYSTEM TECHNICAL JOURNAL, JULY 1952 


makes use of the contour in the complex plane for the polynomial, corre 
sponding to the z-plane circle 1. (This is like a Nyquist diagram 
except that the contour for the variable, z, 1s different.) There will be 

lif and only if the contour for the polynomial encloses the 


origin 


Now the polynomial in (34), and (35), is merely a special case of the 


funetion on the left in (28), and (30). For this special case (30) becomes 
pe lL + H(z 38) 


The polynomial cannot enclose the origin without passing through some 
negative real value. But this requires an //(z) > 1, at some point on 
the contour im question, | 2 1, which happens to be also our useful 
nterval. On the other hand, a a 0 when > R,.2”" 1, and H(z) 
sin the nature of a correction term, which is small in the useful interval 
vhen a ais small. 

Phe conclusion is: There will be no) z,' < 1 unless the approxima- 
tion, a@ to a@, IS 8O poo! that a & exceeds several db in the useful inter 

‘ul 

sides the requirement z, > 1, the z, must meet physical restric- 
tions, Which we found to be the same as those limiting the natural 
modes p,. The z, may be calculated as follows: The z, are roots of the 
polynomial in (35), in terms of 2°. All the roots in terms of 2° are 2, , 
except the two required roots at 35 F which correspond to assigned gain Qa. 
Hach Is & square root of a 2 There are two possible square roots, 
however, differing only as to sign. As far as gain @ is concerned, either 
choice of sign is permissible; for a depends only on 2; . For a physical 
network, however, the choice must be such that Re z, < 0. This choice 
is possible if, and only if 2? has a finite real part. A pure imaginary z, 
corresponds to a negative real z, , and thus negative real roots in terms 
al ire excluded by physical considerations. 

Fable [lists both 2; and z, for a number of values of n. When n is 
even, all roots are physical. On the other hand, when nis odd, one root 
is always non-physical. In a sense, an odd nis not really appropriate 
for the present illustrative problem, with any physical design. An odd n 
must necessarily bring in a real natural mode, which merely increases 
the sort of distortion we are trying to equalize—that is the distortion 
due to unwanted real modes 

The following argument substantiates the suggestion, and also illus- 
trates manipulations of a sort which are frequently useful in more gen- 
eral appheations: The highest order coefficient in (34), K, we, Mav be 


] 


set aside for adjustments to satisfy physical requirements. The rest of 
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"TABLE I Z-Plane Natural Mode Ss for Equalization of Two Identical 
Unwanted Modes 


+ 7071 Non Physie: 
6747 - 3492 + 
7754 Non Phy Sic: 
5977 5340 4 
5204 6441 + 
3582 (.2328 + 1 .7695 2328 + 
6703 0 4 SLST Non Physie: 


2942 i .6084 (.7157 + 1670 7157 + 7 .4670 


- 3757 i .5701 t+ (3918 s 7208 3918 + i .7275 


the coefficients may then be chosen to eliminate terms from the series 
z. (Cy — Co)Tx , representing a a, subject to the previous condi- 


ne n—l 


tion that two zeros must be z z . This replaces by , in 


(35), and changes (36) to: 


Eh a1 - wy (tf a(t” 


+ Rusgoz”™ (2% — 2°)’ 


If n is odd, all the roots z, can be physical only if A, 42 is negative. 
On the other hand, any finite negative R,.42 leads to a larger error, 


a ° > . . 
a — &, than A,4. = 0. Reducing A,,, to zero is the same as reducing 


the degree of the polynomial by one, which amounts to reducing n by 1, 
from an odd to the next smaller even integer. In other words, a physical 
design with an odd number of natural modes is less effective, for the 
present application, than a simpler network, with the next smaller even 
number of modes. 

Note that the z, in Table I are proportional to % . This means that 
root extraction methods need be used only once for each value of n, 
after which the roots may be quickly adjusted for any value of % 
corresponding to any assigned value of the two identical modes, p, 


13. ACCURACY 


The accuracy of a completed design can be checked by calculating a 
from the natural modes p, , and comparing @ with &. It is important, 
however, to have at least some information about accuracy in advance 








rHE BELL SYSTEM TECHNICAL JOURNAL, JULY 1952 


of the detailed calculation of the p, . Otherwise, it may be necessary to 
carry out several designs, in all detail, in order to obtain one satisfactory 
design 

The needed information about accuracy can in fact be obtained from 
the error function H(z), which we formulated for general gain applica- 
tions in (30), and for the present application in (38). The analysis 
which yields (15) may be used to obtain a very similar expression for 
a @, in which R(z)R(—z) appears in combination with the rational 
function of z from (15). It may be expressed in terms of the error fune- 
tion / of (30), as follows: 


log | 1 + H(z (40) 


When //(z) is zero, a — & is zero. When H(z) is small, a — & depends 
on phase //(z) as much as on H(z). When H(z) is a positive real, 
a & is negative. When H(z) is imaginary, @ — & is very small. When 
H(z) isa negative real, a — @is positive. When H(z) is complex, | a — & 
is always smaller than with a real //(z) of the same magnitude. The last 


statement mav be expressed as follows: 
log }1 T Hz } <a as log }1 . H(z) ' (41) 


Phe left hand relation is an equality when phase H(z) is an even num- 
ber of wm radians; the right hand side, when it is an odd number of 
radians 

In the useful interval, where z *, the H(z) corresponding to (36) 


is as follows: 


phase //(z) (2n + 2)¢ + phase <1 


)\s- 
~)Z 


, T : rie » 
\s w varies from 0 to w., @ varies by | radians. The corresponding 


phase of //(z) varies by (nm 4+ 1) radians, which means that //(z) 1s 
successively positive real, imaginary, negative real, imaginary, through 
n + 1 half eveles. This accounts for the oscillatory nature of the a a 
curve, illustrated in Fig. 7. 

The amplitudes of the oscillations are fixed by | H(z) , which varies 


relatively slowly. Specifically, the two logarithms in (41) determine 
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envelopes, between which the actual error curve oscillates. These are 
the dashed lines in Fig. 7. 

The maximum error, in the useful interval, is determined by the 
maximum value of the envelopes, 1.e., 


(a — &) max. = an+2 an (43) 


This function is plotted in Fig. 8, for various values of n. The abscissae 
“distortion before equalization” represent distortion relative to the 
median loss in the useful interval, or one half the total variation in the 
interval. (This is a function of the top useful frequency w, , relative to 
the assigned natural mode jy ; and (7) makes w, po a simple function of 
Z).) The figure is convenient for estimating the values of n needed for 
specific applications. 

The various ripples in a — & do not all have the same amplitude, (43). 
For some values of n and % , the amplitudes are almost uniform; for 
others they are quite variable. A measure of the variability in ripple 
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Fig. 8—Distortion before and after equalization—n natural modes equalizing 
2 identical natural modes 
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umplitude, across the useful interval, 1 


H (2) 
H (z 


14. APPROXIMATION IN THE TCHEBYCHEFF SENSE 


The above analysis suggests a way of improving the design deter 


mined by (37) (or the equivalent, (36)). An optimum a & is commonly 


one Which has the following properties, in the useful interval: 


1 maximum number of “ripples,” 


all maxima of | a & | equal, 


Phis usually minimizes the largest departure in the useful interval, 
thereby yielding an “approximation in the Tchebycheff Sense.’’) Since 
the variation in phase //(z) determines the number of ripples, while 
I determines the amplitudes of the ripples, the above conditions 


will be met if /7(z2) has the following properties, in the useful interval: 


Phase H(z ) as variable as possible, 15 
‘ >) 
H(z) | constant. 


hese conditions may be regarded as alternative design criteria, re 
placing ¢ C.,. They ean in fact be applied to our special example, 
and also to certain other special problems which will be noted later. 


kor more general applications, a suitable //7(z) can be defined, but no 


reasonably simple procedure has vet been found for calculating the re 
(The difficulties will be particularized in a later 


quired constants 
section 

kor the present example, (88) may be used to replace (34), and hence 
also the second equation of (33 - bv: 

7 ‘on )2 log [1 + H(z)] (46) 

(33) requires H(z) to be a polynomial in 2, of degree n + 2, with two 
zeros of {1 H(z)| at 2 3). The object is to find an H(z) of this 
sort, Which also satisfies (45), at least to a good approximation. 
Phe following //(z) does in fact exhibit the required properties: 


H(z) G2 


The funetion is a polynomial because the factor |] r° vie "¢ | is 


divisible by (1 J fz The constants J and G are to be chosen t 
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give the required double zero of [1 + H(z)] at 2° = % . One value of J, 
so determined, is real and of order 1/3 . This is the appropriate solution. 
Then | J"**/2°"**| is of order 1/35"**, when | z| = 1. This suggests the 
following approximation in place of (47): 
H(z) = Gz"""* edd (48) 
| J /z 

The approximation is at least as good as 1/%)""°*, compared with 
unity, both in the useful interval and in the neighborhood of the singu- 
larities Z , and z,. This means that the approximation can be used: in 
estimating the error a — & (in the useful interval), in caleulating J and 
G’, and in finding the roots z, . 

In the useful interval, |z, = 1, and therefore 1/2 2*. Then 
(1 — J/z*) is (1 — J2*)*; and their ratio has magnitude unity. Thus 

H(z) | = |@\, in the useful interval, to order of 1/3)"** compared 
with unityt. With J | < 1, phase H(z) varies over the useful interval 
to the same extent as the phase of 2°""*.t Fig. 9 illustrates the difference 
ina — &, as determined by (42) and (48). These curves, however, are 
for single values of nm and Z ; and the improvement obtained by using 
(48) would be different with different values of n or Zo . 


The values of J and G, determined from (48), and the requirement 
that [1 + H(z)| must have two zeros at 2 = 3% , turn out to be: 


~| 


Note that this J is in fact smaller than 1 


15. GENERALIZATION 


The several sections preceding describe a quite specific example, as 
an introduction to synthesis applications. The next several sections de 
scribe how the specific methods of the example may be generalized, in 
several respects. 

First, the ideal gain, &, is generalized, so that it need not even have 
the sort of functional form associated with finite networks. Then, the 

+ The | H(z) | determined by (42) is constant only to order 1] 


t This is the most we can expect, when we have n singularities, which can pre 
vent the dominance of only lower order terms, through 2*” 
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approximating network gain is generalized, by introducing arbitrary 
frequencies of infinite loss, in addition to the arbitrary natural modes. 


Phe methods are also modified for approximation to an assigned phase, 
instead of gain, or to phase and gain simultaneously. Finally, the anal- 


ysis is modified to permit useful intervals of the “high-pass” type, o1 
in the case of gain simulation) of the ‘‘band-pass”’ type. 


16. APPROXIMATION TO A GENERAL ASSIGNED GAIN @ 


If we now permit the assigned gain & to be general, in the sense of 
Section S, we must return to the formulation: 
ms. Xp x ray 
* cl oo 
ate _ 7 (50) 
> Cuz” og [R(z) Ri 


— 
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If we retain simulation with a network which has n natural modes, and 
no frequencies of infinite loss, we must retain the formulation: 


a= ba CuT'x 
>> Cuz™ = —log K? H( - ah 


The corresponding formulation of the error is (in place of (33)): 


a-a= p oe (Cx — Cu)T 2 


2 (52) 
= —log E (1 - 2) ROR(-2)| 


< m, the following special case of (28) is now required: 
K: [I (1 ~ =) ROR —z) =1 (53) 


Now the reciprocal of R(z)R(—2z) has a power series expansion, in the 
region of interest. (Recall Section 8.) 

It follows that (53) may be multiplied by this quantity, without 
damaging the equality of power series coefficients. In other words (53) 


Let AK, be the coefficient of 2“ in the polynomial expansion of the left 
hand side; and let A, be the coefficient of 2“ in the infinite series ex- 


is equivalent to: 


pansion of the right hand side. Then, 
K; I] (1 7 2) = Ko + Ky" “ 
= 9 
(<s) " p> all 


Substitution in (54) gives 


Ky + Kiz? + +++ K,2” ‘ 2, At” 


In other words, 


Ky oe Ke. I: m (57) 


These relations are directly applicable to network synthesis, provided 
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the coefficients AK, can be calculated. Formulae for their calculation 
mav be derived in the following way: 
If (55) is substituted in (50), the result is:T 
ae = De Cul 
> Cut” log th K,2" 
When 2 0, the second equation reduces to: 
K, e~' (59) 


If the functions of z are differentiated, a simple rearrangement gives: 


> kK? = [— Do kCne* VDD Riz] (60) 


The right hand side may be expanded as a single power series, and then 
like powers on the two sides may be equated separately. The result is: 
ky C.K 
2K2 C.K, 20K 
3K; CoK, — 2C,K, — 3C6Ko 
Synthesis calculations may now be carried out in the following stages. 

The assigned gain @ is expanded as a Tchebycheff polynomial series, to 
determine coefficients Cy, , say through order / n. The equations (61) 


are then used to calculate coefficients A, , also through order n. Each 


successive coefficient is computed in terms of those previously deter- 
mined. Note that the A, , k S n, are fixed by the same number of 


C4—that is, orders k S n 

Equation (57) is now applied to identify Ay with Ay, k < m. If all 
the network degrees of freedom are to be used to get Cy, Cx , index 
m n, and (57) determines the polynomial in (55) completely. Other 
wise, m <n, and coefficients A,,,; to K, are to be adjusted in accord 
ance with specifications of other kinds. When all the A, have been 
determined, the singularities 2, are found by root extraction methods, 
applied to the right hand side of the first equation of (55). 

The previous example might have been carried out in these terms, 
but happened to be simpler in the terms used. If (32) is regarded as a 


special case of (50), and if (32) is simplified (for purposes illustration) 


by using A 1, the corresponding R(z)R(—z) becomes simply 
(1 ) Phen yD Ky.2° 18 


t We may think of these equations as defining an infinite network, with na 


tural modes only, which would match the assigned gain @& exactly 
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l 
(1 —- 2°/3 


> Ke™ = 
thus K, and K, become 


” k+ 1 
RK, = —ar-,, f= Oto « 


: | ey 
K, = —r- k = Oton 


(63) 


If these A, are used to evaluate the polynomial on the left hand side of 
(53), in accordance with (55), and if the polynomial is then multiplied 
by the above special R(z)R(—z), the result is exactly (36). 

The error function H(z), of (30) and (42), may now be defined as 
follows: 


kK? I] (1 — 5) R(z)R(—z) = 1+ H(z) (64) 


The error a — & is again: 
a—a&@= —log|1+ H(z)| (65) 


If (64) is used to express (53) in terms of H(z), a “1”? may be sub- 
tracted from each side of the relation, to get 


me 


H(z) = 0 (66) 


When m = n, this requires an //(z) of the following form, in terms of 
the coefficients K, derived from R(z)R(—z): 


ett + 


+ ¢ 
> Riz” 


H(z) = Kaye 


17. CHARACTERISTICS OF 2 


As in the previous example, |z, | > 1 when the approximation, @ to 
@, is at all reasonable. The z, are again zeros of 1 + H(z); but now 
H(z) is defined by (64). If | H(z), < 1, when | z 1, there will be 


the same number of zeros of 1 + H(z) as poles, in the region | z| <1. 


Any poles would have to be poles of R(z)R(—z). In Section 8, we noted 
that this function is regular in the region | z!| < 1. Hence, there will be 


no poles, and there will be no | z,| < 1, under ordinary accuracy con- 
ditions. 


As before, the z, can be chosen in accordance with the physical con- 
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ditions, provided none are pure imaginaries. Since an imaginary 2, Is a 


negative real z, : 
There must hy no negalive real ces 


Phere will be no negative real z; if the polynomial Zz Ky2- in (55) is 
non-zero at all negative real 2. If the requirement is violated, initially, 
one or more A, , of the highest orders, must be modified. Graphical 
methods are likely to be useful for this, combining plots of the original 
polynomial, and proposed changes. An approximation of the form 
Cy Cy, k S m, will still be realized, but with m <n. 

The error function corresponding to m <n ts as follows, in place of 


G7 
H 


IS ACCURACY 


The accuracy of match again may be estimated by the means of (41), 
using //(z) of (67) or (68). H(z), however, may not be so easily cal- 
culated as for the previous example 

A simpler but less reliable estimate of accuracy is furnished by the 
error in the first unmatched coefficient in the Tchebycheff polynomial 


series. If A, K, through k m, the leading terms in various series 


are as follows. First, from (64) and (68), 


K: I] (1 ») R(z)R(—2z me 3 Ro r 


using this in (52) gives: 


" , ; Kons 
> PELs ot | log | t - 


hen, from the properties of logarithms, 
* Knit 
S ((' 


od 


Consequently (also from (52 


Ky 


This is the same as the leading term of H(z), except that 
placed by — Ts... If m n, the same equation holds with A, 4; 
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eae bie K nut 
Ky 

lopes of the ripples in a — &. The variability of the envelopes, across 

the useful interval, depends upon higher order coefficients, in compari- 


The coefficient in (72) is a sort of average of the enve- 


son With the leading term. Calculation of higher order coefficients is 
relatively complicated. 


19. APPROXIMATION IN THE TCHEBYCHEFF SENSE 


The criteria (45) carry over to general assigned gains, as conditions 
on H(z) which, if realized, are usually sufficient to establish approxima- 
tion in the Tehebycheff sense. For this purpose we must use the H(z) of 
(64), rather than (67) or (68) (which correspond explicitly to Ca. = Cx , 


hk < m). In terms of the polynomial and series representations of (55), 


the H(z) of (64) becomes: 


Ko + K,2? --- Kz" 


> = > R 2h (73) 


The following somewhat special problem is easily solved, in these 


H(z 


terms, and has a direct bearing on various quite different synthesis 
techniques: A network is to be designed which combines the functions 
of an equalizer or simulator, with those of a filter, or selective network. 
In the useful interval, an assigned gain variation & is to be approximated 
in the Tchebycheff sense. At higher frequencies, there is to be a rapidly 
increasing loss, or “sharp filter cut-off.’’ The number of natural modes, 
n, is to be more than sufficient to match & to the required accuracy, in 
the absence of a selectivity requirement, the latitude being used to pro- 
duce the required sharp cut-off. In particular, n is to be large enough so 
that an n term match of Tchebycheff coefficients produces errors that 
are negligible compared with those accepted as a price of the sharp 
cut-off. 

On the above assumption of an ample n, the infinite series zz K,2" 
in (73) may be truncated after the term of order n, and the errors due to 
the truncation may be neglected in calculating the design error a — &.t 
Then (73) becomes 


: Ko + Ky2? +--+ K,2*" 
i Ky + K,2° —) K,2° 


H(z) = — | (74) 


+ The truncated series is merely the polynomial on the left side of (56) which 
would be obtained if the filter selectivity were ignored, and m were given the 
maximum value, 7 
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If a sharp cut-off were not required, this approximate H(z) could be 
made exactly zero, by using K, K, for all coefficients. Then the actual 
design error would be determined by the approximation inherent in the 
use of (74) in place of (73). For high selectivity, however, A, should be 
much larger than K,, as large as possible within assigned limits on 
a — &in the useful range. (It is readily established that A,2z” will deter- 
mine a at asymptotically high frequencies.) The other A, are then to 
be adjusted so that a — & exhibits the desired “equal ripples.” 

The following //(z) has the functional form (74), and also meets con- 
ditions (45 


(75) 


H(z) = Gz 


| Ke + Kye’ --- Kz” 


Multiplying G2" into the numerator gives a rational fraction which 1s 
obviously consistent with (74). The coefficients Ay of (74) which corre- 


spond to (75) ure: 


kK, K, + GR. (76) 
In the useful interval [>> K./2"] is [3° K.2"|*. Hence the polynomials 
in z and 1/z have identical magnitudes, in the useful interval; and, 
since also | z | 1, | H(z) G in (75). The phase variation, over 
the useful interval, is the same for H(z) as for 2°", which yields the same 
number of ripples in a@ & as an ordinary Tchebycheff filter of like 
degree. 7 
The constant G is arbitrary, except that its sign must be properly 
chosen to avoid non-physical natural modes. Increasing @ increases the 
filter selectivity, but also increases a — & in the useful interval. G and n 
are to be chosen together, to realize an assigned selectivity within an 
assigned limit on distortion 
The above analysis may be related to the following filter problem: 
Required to design a filter which has flat gain, in the useful interval, 
but which has m assigned frequencies of infinite loss, in addition to n 
arbitrary natural modes (m Ss n). The n arbitrary natural modes may 
be regarded as compensating for gain variations due to the assigned 
frequencies of infinite loss, in the useful interval, while reinforcing their 
effects at other frequencies. Compensation of effects of the infinite loss 
points is the same as simulation of the effects of natural modes at the 
same (assigned) frequencies. The approximation in the useful interval 
+ This assumes an a@ with the general characteristics described in Section 8, 


which are such that the numerator and denominator of the fraction in (75) will 
each have a net phase shift of zero, across the useful interval 
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is to be no better than necessary, so that there may be a maximum 
reinforcing of losses at other frequencies. In these terms, (58), and 
ye K,.z" in (73), correspond to the assigned natural modes (at the 
same locations as the assigned frequencies of infinite loss). Then the 


ideal >> K,2" is itself a polynomial, of degree m < n, and (74) is exact, 


rather than an approximation to (73). Then (76) determines the n 
arbitrary modes in such a way that the net filter gain approximates 
zero in the Tehebycheff sense, over the useful interval. 

A different procedure for obtaining the same result is described in the 
author’s paper “Synthesis of Reactance 4-Poles’’.” The above analysis 
of the filter problem is of interest in relating the more general synthesis 
techniques, in terms of Tchebycheff polynomial series, to previous filter 
theory. 

Similar filters have also been obtained by Matthaei’, on a potential 
analogy basis. He includes, however, somewhat more general filter char- 
acteristics, for which he obtains only approximately equal ripple errors. 
Analysis of the sort described above may be used to clarify Matthaei’s 
analysis of the conditions under which he obtains exactly equal-ripples. 

Equation (75) may be related to work of Bashkow’. The (arbitrary) 
amplitude of the (equal) maxima of _a@ — &, , computed from H(z) of 
(75), depends only on |G, . The frequencies at which the maxima occur 
correspond to phase H(z) = sm, which is independent of ,G@ |. Thus, 
the locations of the maxima are invariant to the arbitrary amplitude, 
within the range where (75) applies. (75) applies only when (74) may be 
used in place of (73). Generally, (74) only approximates (73), and the 
approximation introduces small variations in the maxima of | a — @ 
(when @ corresponds to (76)). If the maxima themselves are sufficiently 
small, the small variations will be large percentage variations; and the 
adjustments to compensate for the variations will yield significant 
shifts in the location of the maxima. In other words, the locations of 
the maxima of |a — &|, required for equal amplitudes, are largely 
invariant to the magnitude of the equal amplitudes, but only to an 
approximation which becomes worse as the amplitudes are decreased. 

Bashkow states the invariance of the frequencies of maximum 
|a@ — &!|, as a more or less empirical conclusion, based on a quite dif- 
ferent approach to the same synthesis problem. 

Equation (75) may be related also to work of Kuh.’ The natural 
modes z, are zeros of 1 + H(z). In other words, H(z,) —1. Using the 
H(z) of (75) gives the following: 

on ! 


Ko+ Kize+-:' Kz = Gz" 4 R, + - coe “| (77) 
\ 


~« 
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It must be remembered, however, that this formulation is permissible 
only if the approximations, inherent in (75), are justified when z = 2, 
(as well as in the useful interval). Taking the logarithm of each side 


gives: 
log {K 


log (—G) + 2n log z, + log< Ko 4 
\ 


Mquation (58) may now be applied, to replace the logarithms by 
power series, proy ided the truncation of the series is again justified, and 
provided the convergence of z. C42” is also proper, at both z = z, and 


1 z,. This gives 


>, Cuzs' >, Cx/ze* + 2n log z. + log (—G) (79) 
Summations : are all with respect to &; and there is one equation for 
each o.) This is a suitable rule, for obtaining an |) @ — &| with equal 
maxima, Whenever the approximations are in fact unimportant. It is 
not at all clear, however, just when the approximations become. sig- 
nificant 

Kuh uses the potential analogy approach for the same sort of sVvnh- 
thesis problem. He spaces the natural modes along a p-plane contour 
defined in fairly complicated potential analogy terms. It can be shown, 
however, that mapping his potentials from p plane to 2 plane leads to 
79) 

When the network is to approximate & in the useful interval, but is 
nol required to supply selectivity at other frequencies, the approxima- 
tion (74) is usually untenable. It is generally necessary to retain the 
exact formulation (73). 

When selectivity is not required, the phase excursion of //(z), in the 
useful interval, can usually be increased to that of 2°""~ (as in (67), 
corresponding to C Cy k <n). As a step toward meeting the first 


condition of (45), one may then write (73) as follows: 


> n+l 
rey l 
: — er t } (), 4 
? kK, +1 a 


l 
> K 2" 


The coefficients Ky : z. are fixed by & The only arbitrary 
iva 
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design constants are the Q, . They. are to be small enough so that they 
do not affect the total phase excursion /7(z), when | 2 1. Their 
specific values are to make | //(z) approximately constant, when 

z| = 1. In general the (required) series in 2 in the numerator makes 
it extremely difficult to determine the required values for the Q; . No 
reasonably simple general procedure has yet been found. 


20. ARBITRARY RATIONAL FRACTIONS 


The preceding sections were devoted to the approximation @ to &, 
using m arbitrary natural modes, but no arbitrary frequencies of in- 
finite loss. Similar techniques may be used when there are n” arbitrary 
natural modes and n’ arbitrary frequencies of infinite loss. As the appli- 
cations become more involved, however, routine calculations must be 
supplemented increasingly with an element of art. 

For simultaneous design of natural modes and frequencies of infinite 
loss, we must go back from (31) to the @ formulation in (21). This we 
shall now write: 


a=) CuTx 
zx C442 = log D 


The functions V and D are polynomials. The coefficients will be defined 
as follows: 
N = Ky + Ky2’ -:- Ky 


/ 


(S82) 
D=1+K,z -:- K, 


By comparison with (21), the zeros of NV, in terms of 2°, are the z,”. 
(Note the minus sign in 81.) The zeros of D are then the z,”. For physical 
networks, n” = n’. 

Equations (50), describing & may be retained as they stand, Com- 


bining (50) and (81) gives, in place of (52): 


= (C's, = € h ) T's, 
= (Co. - Cu 7" = log E (2) Ri » | 


The function R(z)R(—z) is exactly the same as before. The reciprocal 
of the function will still be Zz. K,z", with the Ky related to Cy by (58), 
(59), (61). The new rational fraction ND will appear where previously 
we had the polynomial Ky + --- K,2°" 
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Accordingly, the rule for Cs, Cs ,k < m, now becomes, in place of 


(84) 


. . ti ~~ 
This condition may be used to determine the coefficients Ay , Ay of 


Vo and D n combination with conditions of other sorts, when 


m nw” +n’). When the coefficients have been calculated, the (z-plane) 

natural modes z, may be determined from the roots of N, exactly as 
ran . / 

the 2, of previous sections. The infinite loss points z, may be calculated 


/ 
from the roots of D, in exactly the same way except that Re 2, need 


not be negative. Signs of the z, must be such that complex and imaginary 
/ / 


are in Conjugate pairs. Note that there can be conjugate imaginary 2, 
only if D has a corresponding double negative real zero. 
When m n” + n’, the following method may be used to calculate 


the A, and Ky determined by (84). The relation is first multiplied by 
i). to get: 


D :® K,2° (85) 

Phen algebraic manipulation is used to evaluate the power series equiv- 

alent of the right hand side, through terms of order n” + n’, using the 

known values of the Ay, but general values of the Kk; of D. Each coef- 
ficient is a linear function of the unknowns, K; . 

Now the polynomial NV, in 

fore (85 


(85), has no terms of order k > n”. There- 
requires zero coefficients in the expansion of the right hand 
side, from order 1” + 1 to order n” + n’. Equating these coefficients 
to zero gives 1’ linear equations in the 2’ unknown Ki. . Solving for the 
K, determines polynomial 2. The values calculated for the K; may 
then be used in lower order coefficients of the expansion of the right 
hand side of (S85), which are exactly the coefficients Ky of NV. 

When n” n’ 0 or 1, a continued fraction method is likely to be 
preferable. Various established techniquest may be used to convert the 


series : 3 A into a continued fraction of the form: 


> K 


example, Fry’s appheations of continued fractions to network de 
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If the continued fraction is truncated after the term of order m, and is 
rearranged as a rational fraction ND, it will obey equation (84). The 
degrees of N and D will be such that n” + n’ = m, and n” — n’ 0 
or 1. The continued fraction may be associated with the hypothetical 
ladder network shown in Fig. 10, with variable impedance shunt branches 
proportional to 2. The impedance of the (truncated) ladder is ND. 


21. ACCURACY 


The accuracy of match, a — &, may again be evaluated from the 
final network singularities; or by (41), with H(z) as in (30), before the 
singularities have been determined from roots of N and D. A rougher 
estimate may again be obtained from the error in the first unmatched 
term in the Tchebycheff polynomial series. As before, (equation (72) 
this is equal to the leading term in H(z), with 2” *~ replaced by — Tomy. 

The rational fraction in (30) is the same as our present V2). In terms 
of N/D, (30) becomes: 


- R(z)R(—z) = 14+ H(z) (87) 


N 
l 


If (86), or Fig. (10), is used to determine NV and D, the leading term in 
H(z) turns out to be: 


(— )mt1z2m+2 


IT z= 2 Bats 
(dy. +++ Om) Amsi Ko 
The corresponding mismatch in Tchebycheff polynomial terms is: 


(—)™ 


. 
= (a2 *** Am) AmiiKo 


22. ZEROS AND POLES 


When frequencies of infinite loss are to be:chosen, as well as natural 
modes, the situation in regard to z,| < 1 is somewhat less favorable 





| 


Fig. 10--A ladder network representation of the continued fraction (S6 











H50 rHE BELL SYSTEM TECHNICAL JOURNAL, JULY 1952 


It is still true that | + H(z) will have the same number of zeros as 


poles in the region z > < 1, 80 long as a & is reasonably small in the 
interval 1. In equation (87), however, the poles of 1 + H(z) 


include the zeros z, of D (the arbitrary infinite loss points), as well as 


the poles of R(2)R(—2z). When the coefficients of D are to be chosen as 
in the previous section, the contour rule merely says that any 2, and 2, 
in the region z!) < 1 will oecur in like numbers 

Fortunately, the frequent occurrence of |2z, > < 1 is softened by the 
following curious circumstance. Almost always, any z,| and |z, | <1 
are so nearly identical that factors (2 2) and (z — z) may be can- 
celled out without any important effect on H(z), ora — &. Cancellations 
of this sort were encountered a number of times before an explanation 
was discovered. Actually the explanation is quite simple. 

At any zero of 1 + H(z), H(z) 1. On the other hand, H(z) is 
small when | 2 1. Generally, it is much smaller in most of the inter- 
val 2 < 1. For instance, when (C» Cy through k = m, H(z) is pro- 
portional to 2" °°, in the neighborhood of 2 0. As a result, | H(z) 
rarely becomes as large as 1, in the region 2 > < 1, except in the very 
close proximity of a pole. In other words, in the region | z > < 1, any 
zero 2 is usually very close to a pole 2,—usually so close that the 
corresponding factors 2 >, may be cancleled out without significant 
eflect on a a 

The occurrence of non-physical natural modes (Rez, = 0) is the same 
as before; but adjustments to correct for these, in an efhicient manner, 
are much more complicated. In addition, there may be non-physical 
infinite loss points, z,. To correct for non-physical singularities, the 
simplest procedure would be to change one or both of the highest order 
coefficients in N and D of (82), that is AY., and aon This would be 
inefficient, however, for it would spoil the match of (,,., to €@,.. , or Cy 
to€ Phe unmodified design, defined by (84), can match terms through 
order 2” + n’, and it is desirable to change only the highest order terms 
in adjusting the design. 

More efficient adjustments are in fact feasible. They sometimes re- 
quire an increased element of art; but the art may be based on specifie 
principles. Some particularly useful principles are described in the next 
section. These apply to various other corrections besides correction of 
non-physical zeros and poles. Examples are reduction in phase to make 
two-terminal realization possible, and inerease ino shunt capacity in 
two-terminal designs. In general, they offer a means of making 
m no + on” in (S84), and using the remaining degrees of freedom to 
meet other conditions 
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23. MODIFICATION OF ND 


Suppose V, D, and Ny Dz are two rational fractions, representing 
special choices of N and D in (82), such that: 
Ny tial 
dD, 
Nz i 
Dy 


(90) 


Then suppose F is a function of 2° such that 


F=0 (91) 


Tha f 7 : ere iets : : ; : ie We - 2 
Phe following combination represents an approximation to > Ay: 
of the order indicated :t 


Ni + FN,™ = 4) 
D, + FD» ~ > Kz 


m = m,, or mz + pw, Whichever is the smaller. 


The left hand side of (92) may be used as VD in (84), to match 
Cy to Cy through k = m. Adjustment of the function F may be used to 
satisfy other requirements, in addition to accuracy specifications. 

Frequently, NV; D,; may be the rational fraction corresponding to 
truncation of the continued fraction, (86), after the term in a, : 
Then N»/ Dz, is likely to be a truncation of order m < n” + n’. The 
corresponding F is likely to be proportional to 2“, or at most a simple 
polynomial in z. When F is a constant, and m = n” + n’ — 1, the 
use of these particular rational functions in (92), to determine NV, D, 
corresponds to matching Cy to Cy through k = n” + n’ 1, but 
leaving Cooney.) Subject to adjustment. Specificially, Co,,.-,,. depends 
on the choice of F, which may hinge upon such special conditions as 
the elimination of non-physical singularities. 

Problems which call for more complicated combinations are by no 
means uncommon. Skill may be needed in the choice of specific com- 
binations which will solve specific problems. Computations may be 


t The relationship is easily established by noting that 


N; ain \ > 
: D Ky24 D> K,2? 
FN, -_ ' D 
> K,2z* = + f 
dD D 
hk 


D D 
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systematized, to a considerable extent, by using the error formula (88), 
and other relations between the coefficients of the continued fraction, 
and the rational fraction truncations of various orders.T 


APPROXIMATION TO BOTH GAIN AND PHASE 


The applications described in previous sections relate to approxima- 
tions to prescribed gain, &, without regard to the associated phase. 
(Quite similar methods apply, however, to the simultaneous approxima- 
tion of gain and phase 

The starting point is equation (20). Replacing products of factors by 


polynomials gives, in place of (81): 
> Ti, k even and odd 
log : 


The polynomials are HOW as follows, in place of (82): 


rf wr 


N = Ko + Kiz-++ Kara” 


. (95) 
D 1+ Kyz-+> Kyez™ 


If only natural modes are to be used, the suitable replacement for the 
first equation or (55) is here obtained merely by using D = 1, and K,, 
<i place of their squares. ) 
\ comparable expression is needed for the assigned gain and phase 
& + 78. In place of (50), we now repeat (22), and redefine the coeffi- 
cients A, in accordance with 


ip } Cts, kk even and odd 
® AC 2" log R(z) log oe K,2* 


Phe definition of A, has been changed in such a way that it is now 


(96) 


related to Cy 2 exactly as it was previously (in 58) related to Cx, . 
Kquations (59), (61) may be applied to calculating the A, by merely 
substituting therein a C,/2 for every Cy 


t For example, a simple recursion formula may be used to assemble the poly 
nomials N and D which correspond to truncation of the continued fraction (86) 
it a number of different points. Specifically, ?, = Pro + - Pas, where P 

ApAn— 1 
is either \ or D and P, corresponds to truncation of the continued fraction after 
the term ina, . The formula holds for n 2 2 
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Equations (84), (85), (86) may now be modified, for the new NV, D 
and AK, , by merely using z in place of 2° wherever it occurs (including 
z‘ in place of 2“).¢ The modifications of equations (84), (85), and the 
truncation of (86) after a,, now lead to C, = Cy, k < m, instead of the 
previous C = Cy . This means that m must be twice as great to match 
coefficients out to the same actual orders. This is to be expected since 
now one half of our design parameters are used to approximate phase 
B, leaving only half for approximating gain & Equation (89) must be 
changed not only in regard to the orders of Cy, C, , but alsa in regard 


to the factors § in (94), (96). This gives 


} - = (97) 
(dz +++ Am)? AmyiKo 


The most important change is in regard to the zeros and poles 2, . 
The polynomials NV and D now determine z, and z, directly, instead of 
their squares. There is no opportunity to adjust the sign of Re z, by 
choosing the correct sign of 1/22. When non-physical singularities ap- 
pear, adjustments of high order coefficients may be tried. Section 23 
applies provided z° is replaced by z. If the specification of the problem 
permits added delay, linear phase may be added to & + 78 to increase 
the probability of physical singularitiesf. (Addition of linear phase 
changes only C,, in ba C.T,. A negative change in C, increases the 
delay.) 


25. APPROXIMATION TO AN ASSIGNED PHASE B§ 


Sometimes it is required to approximate an assigned phase, without 
regard to gain. More commonly, it is required to approximate an as- 


‘ 


signed phase, using an ‘‘all-pass’” network, which has a theoretically 
zero gain. These two problems, however, are very nearly identical, due 
to circumstances explained at the end of this section. 


For approximation to phase only, we go back to the 8 equation in 


(21). As before, products of factors (2 z,) are replaced by polynomial 


- wie 

t and = in place of = 

t The well known relation between the gain and phase of any physical network 
(See for instance Bode") may give some information regarding the reasonable 
ness of 8. It must be remembered, however, that departures of network gain a, 
from the assigned gain @, outside the useful interval, may affect the permissible 
phase 8, within the interval 

§ Up to the present, applications to phase problems have not been developed 
to the same extent as for gain Techniques have been explored however, to deter- 
mine how such applications may in fact be carried out. 
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equivalents. Then, in place of (81) or (94), we have 
ip = : > CT, 
y k odd 
> C2’ > log : 
D 
Using nto represent n” + n’, the total number of network singularities, 
we may write NV and D as follows, in place of (82) or (95): 
\ 1+ Kyz + Ko2’ + Kyz --> + Kz” 
D | K,z + Ke Kyz +++ (—)"K,2" 
Notice that Nand D are related by 
D(z N(—2), (100) 


which is required by the form of the 8 equation in (21). 
To arrive at a design procedure most easily (but not the simplest 


design procedure), one may express the assigned gain B in the following 


Wilh comparable to DS) and (96 


iBp=> C.7., kodd 
>, C2’ log 0 K 2" 


(101) 


Coefficients Ay may again be calculated by a modification of (61). This 
time Cy is replaced by Cy, wherever it appears in (61), and then all 
even ordered C, are made zero (since only odd terms appears in »@ C2 
of (101 Note that even ordered Ky, are not usually zero, even though 
even ordered Cy are 

The degrees of N and D, in (99), are such that we can make C, 


through terms of order / 2n. This requires merely: 


N ** en gp 
= Ky2 (102) 
D du ” a 


\s stated, the condition applies to C, of both even and odd. orders. 
Since even ordered C, are zero, it means that at least n even ordered 
(, will be zero, in addition to the match between n odd orders. (102) 
is sufficient to determine an N and a JD without reference to (100). If 
the (equal) degrees n of (99) are assumed, however, the N and D deter- 
mined by (102) will be found to obey (100) automatically (provided 
S° Ky2 corresponds to an odd series $5 C,2", as here assumed). t 

\ simpler method for computing the same N and D takes advantage 


t This was discovered by Mrs. M. D. Stoughton 
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of the known relation (100), connecting N and D. Let FE and O be re 


spectively the sums of even and odd terms in NV. Then N is / 
(100) requires D to be E 


+ and 
of (98) as follows: 


0. The ratio O FE may be related to b Cyz 
0 P 
RB —tanh 3 z C2 


Now let two convergent 
that: 


(103) 


series, respectively even and odd, be such 


O 


E = —tanh } > C2’ 


(104) 
Let coefficients K, be defined by: 


E+0= ss Kyz (105) 


Then EF and O are respectively the sums of the even and odd terms. 


The complete series may now be related to the (odd) series }> €,2‘ as 
follows: 


> 3Cxz = —log >> Ky2’ (106) 
This fixes the K;, of E + O in terms of the C 
To make Cy, = C, through m odd orders, (102) is now replaced by 
| eel | " 
BB vane 
mo 


The symbol = designates equality of power series through m odd orders. 


(All even terms are now zero on both sides.) The right hand side may be 


expressed as a continued fraction of the following form, comparable to 
(S86): 


0 


EK 


(108) 


Truncation after only the m“ term gives the O/E of (107). 

The coefficients of O and E may be calculated by an appropriate 
modification of (61). (Calculate like A, of (101), after dividing all C;, 
by 2). After O and FE have been evaluated, by truncating the continued 
fraction (108), their sum gives polynomial N of (99). 
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The natural modes and frequencies of infinite loss are determined 
from the zeros of the polynomial NV. By (21), each zero is either a (z- 


’ 


/ . ° ° ‘ 
plane) natural mode, z, , or the negative of an infinite loss point —2, . 
If gain variations are inconsequential, there is likely to be some latitude 
‘7 ; 
in designating each zero as az, , or asa —2 


\ zero of N with a‘positive real part would make a non-physical natural 


mode, and hence it must be a —z, , corresponding to an infinite loss 
point. A zero of N with a negative real part can be a natural mode ihe; 
but this may not be required. It may be either a 2, ora —2, , provided 
conjugate zeros are assigned in the same way, and provided the total 


number of >, does not exceed the total number of z, . The latter con- 


dition requires: 


At least half the zeros of N 


must have negative real parts. 


Phe continued fraction (108) shows how many zeros will have nega- 
tive real parts, before any zeros have been calculated. The following 


theorem makes this easy: 


The number of 2€TOS of N which have negative real parts 
is equal to the number of positive coefficients in the trun 


cation of the continued fraction (108) which determined N. 


When gain is not to be disregarded, but is to be exactly zero, the 
synthesis technique needs few changes. The phase of an ‘‘all-pass’’ net- 


v7 
work is related to the natural modes z, as follows: 


13 2C; T:. k odd 


log ; ( 109) 


This may be regarded as a special case of (20) for a = 0 (which makes 
( O tor k even, and also happens to require z, =— Ze ). In functional 
form however, it is more like 78 of (21). It differs in only two regards. 
In the power series in z, each Cy, is divided by two. In the rational frae- 
tion in z, all the zeros correspond to natural modes, and the poles cor- 
respond to frequencies of infinite loss; but the poles are also exactly the 
negatives of the zeros, as in the 73 equations of (21). 

\ccordingly, the phase synthesis technique which ignores gain varia- 
tions may be applied to the zero gain form of the problem by cutting 
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every C, in two. All zeros of N = E + O must be construed as natural 
modes z, . Finally, the network must have as many infinite loss points 
as natural modes, such that 2, = —2z, . (Integer n is now the number 
of natural modes, rather than the total number of singularities.) 

For physical networks, all the first n terms of the continued fraction 
(108) must now be positive. To meet this condition it may be necessary 
to add linear phase to the assigned phase (by adding a negative cor- 
rection to C,). It appears that sufficient linear phase will always lead 
to a physical design, provided the number of modes n is increased to 
retain a reasonable accuracy. 


26. LINEAR PHASE 


When the assigned phase B is linear, the calculations are relatively 
simple. 
If adelay D is to be approximated over a frequency interval extending 


tow = @, 
1B = — Des, T (1 10) 


If delay D is to be realized without regard to gain variations, the ap 
propriate OE is 


Dw,z 
= tanh - (111) 


A known continued fraction expansion of tanh XY may be applied to 
(111), to obtain the coefficients of (108) without bothering with (105).T 
The result may be arranged as follows: 


l 
Dw,z 5-2 
Dw.2 
Truncation of the continued fraction gives O/F, and then O + EF. The 


: l P ; 
zeros Z, turn out to be proportional to D’ and therefore root extraction 
techniques are required only for one D, for each n. The zeros are tabu- 
lated for sample n’s, in Table IT. 


+ For the expansion of tanh X, reference may be made to a text on continued 
fractions by Wall'', page 349, equation 91.6. 
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| ABLE I] Z-Plane Vatural Mode 8 for Linear Phase 


7 


67782 + 2 3.50876 


5.79242 1.73446 
1.20758 4 5.31484 


7.29348 
>. 70892 


64954 


18532 


14204 


$7142 + 2 5.25256 


8.49668 + 7 1.73510 
5.03100 4 § OS532 
Phe error in the first mismatched Tchebycheff coefficient is a rough 
measure of accuracy. It may be shown to be 


2n-+1 


“(Dw.) 
: | (113) 


2n 1) P(2n + 1) 
This measure of accuracy is plotted in Fig. 11, for various numbers of 
natural modes n. A sample detailed curve of 8 B is shown In Fig. 1Z. 
vith dotted lines corresponding to the estimated error (113). 

If delay D is such that the error is reasonable, all the zeros may be 
natural modes. [If these are combined with a like number of infinite 
loss points, such that z, “” an all-pass network will be obtained, 
instead of one which approximates D without regard to gain. The all 
pass network will produce twice the delay, and twice the nonlinearity 
of phase. In other words, for an all pass network, both coordinates in 
Fig. 11 must be doubled. 


27. SIMPLIFICATION OF SINGULARITY ARRAYS 


In complex communication systems, a single equalizer may be re- 
quired to correct for a number of effects. In a coaxial cable system, for 
instance, a single network in the standard repeater may be required to 
compensate for the following: Cable attenuation, characteristics of input 
and output networks, effects of interstages (significant because the feed- 
back is limited), and distortion due to variable controls at mean settings. 
Pechebyeheff polynomial methods may not be efficient when applied 
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directly to all these effects. They may still be useful, however, when 
applied in the following way: 

Separate arrays of singularities are determined, which match the 
separate effects to required accuracy, using any convenient methods. 
Minimum network complexity is not required at this point. Combining 
all the singularities in a single array gives an initial design which is 
sufficiently accurate, but may use many more singularities than are 
actually necessary. Tchebycheff polynomial methods are now used to 
obtain a simpler set of singularities, which approximates the initial set 
to sufficient accuracy. This has been designated “boiling down” the 
original set. 

In a problem of this sort the assigned characteristic has the network 
form, as well as the network characteristic which is to approximate it. 

The example discussed in Sections 10 to 14 is also a problem of this 
sort.) As a result, equations (20) and (21) apply to & and 8, as well as 
to a and 8. This makes it possible to replace > » K.z" and > R,2", of 
(55), (56), (96) ete., by a finite rational fraction N, D. If both & and B 
are to be approximated, the following is derived from (20). 


I (1 - 2) 


> 3Crz* = log K, = —log 


I] (: ”) 


rar . / . . 
he singularities 2, , 2, correspond, of course, to the network singu- 


r 


larities which are to be boiled down. If only &, or only B, is to be ap- 
proximated, suitable modifications are readily derived from (21). 
The boiling down is accomplished by requiring 


Bee 


5s (115) 


where ND is of lower total degree than N/D. If m = n” + n’, and 
n” n Q or 1, the continued fraction method can again be used. 
This requires expansion of ND in continued fraction form, instead of 
> R. 
a, Ai2 


\n example of a boiled down set of singularities is illustrated in Fig. 13. 


28. GENERALIZATION OF THE USEFUL INTERVAL 


All the previous analysis applies to a useful frequency interval —a,. < 
w +w,. Its important characteristics are as follows: It is a single 
continuous interval, with w 0 at its center. Useful intervals with other 
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other characteristics may be obtained, within limits, by changing the 
definitions of z and z, , in terms of p and p, (equations (5) and (8)). 

In all cases, the definition of Tchebycheff polynomial 7, remains 
the same in terms of z. The interval of orthogonality remains z = 1; 
and the relation between p and z is always such that the useful fre- 
quency interval is the p-plane mapping of | z| = 1. The relation must 
also be such that rational functions of p may be expressed as products 
of rational functions, in z and 1/2 respectively, corresponding to (13), 
(14). At the same time, the physical restrictions on network singulari- 
ties p, must translate into manageable restrictions on the z-plane singu 
larities z,. It is restrictions such as these that limit the manageable 
useful intervals. 

It is easy to apply the “low-pass” techniques to ‘‘high-pass’’ in- 
tervals, extending from w, , through ©, to —w,.. The appropriate trans- 

SINGULARITIES 
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Fig. 13—An example of reduction in complexity 
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lormation, re plc iy 
(116) 


With this transformation, the whole of the previous 2-plane analysis 
may be applied at once to high-pass useful intervals, except where 
linear phase is involved 

Phe situation is more complicated in regard to ‘‘ band-pass” intervals. 
If the useful interval includes the frequencies between w, and w 2, the 
complete useful interval (p-plane mapping of |z, = 1) must include 
also the ‘image’ Trequencies, between We] and We? . Otherwise, 
conjugate complex z-plane singularities z, will not lead to conjugate 
network singularities p,. When there are two disjoint parts of the use- 
ful interval, the appropriate relation between p and z is relatively com- 
plicated. Up to the present, no corresponding technique has been dis- 
covered for approximating assigned phases over band-pass intervals, 
in Pehebyveheff polynomial terms. Gain approximations can be handled, 
however, and for a quite simple reason. Gain funetions are even fune- 
tions, and behave in the p° plane much as gain-and-phase functions 
behave in the p plane. In the p> plane, —w and +w are identical, and a 
band-pass useful interval is a single segment of the w axis. 

hor gain approximations over a band-pass interval, (5) may be re- 


place dl by ° 


Phe three coefficients, a, b, ¢ are subject to two conditions, stemming 
from the requirement that the interval _z, = 1 must map onto the 
interval w) < w < w. This leaves one arbitrary degree of freedom. 
Its choice may be related to ordinary least squares approximations in 


the following wav: 


If a S° C47 , the first n terms approximate a in the least squares 
ane 


sense. In other words, the integrated square of the error is a minimum, 
relative to all possible choices of the first n coefhicients (Cs, ‘ provided 
the integration extends over the useful frequency interval, and= in- 
cludes an appropriate ‘‘weight function’. When (117) relates z to p, 
the arbitrary degree of freedom in the choice of the constants a, b,c 


permits selection of any one of a family of weight functions, Conventional 











NETWORK SYNTHESIS 663 


least squares analysis may be applied to determine these fune- 
tions.T 

In applying least squares analysis, it must be borne in mind that the 
network gain @ does not approximate the assigned gain & in the simple 
least squares sense. When Co, Cy fork S n, a — & depends upon 
two least squares approximations. The first n terms of > ('»,T» represent 
a least squares approximation to a@, and are made identical with the 
first n terms of b Es «Ty , which represent a least squares approximation 
to @. 


When (117) relates p to z, z-plane singularities z, may be defined by: 
1\: 
a+b (:. ) 
Po <3 
1\ 
l+e <¢ : 


a5 


Re z, to have same sign as Re p, 


An additional singularity, 25 , is also needed, corresponding to the finite 
poles of (117). It may be defined as follows: 


(119) 


When p, p, in @ of (2), is expressed in terms of z and z, , (117) 
introduces denominator factors (1 — 2/29) and (1 1 /zo2°). As a re- 


sult, a of (21) must be changed to the following, for band-pass intervals: 
> CT» 
; Tl (1 | =) 
2. Cy2" = log K; -_ 
IT (1 . mm) 


“-¢o 


( 3 (120) 


When definite values have been chosen for a, b, ¢ of (117) (in order 


that the C, may be caleulated), (1 2 29) in (120) is not subject to 
arbitrary adjustment. This situation can be handled by defining ND 
as the rational fraction in the @ equations of (21), as before, but re 


t For general discussions of orthogonal functions and least squares approxi 
mations, see Courant and Hilbert®, and also a short text by Jackson.” 
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placing (84) by 
2) > Kiz™ (121) 


Kig. 14 illustrates an application of the technique to the simulation of 


a coaxial cable attenuation (which is nearly proportional to Yw). 


29. RECAPITULATION 


Tchebycheff polynomial series may be applied advantageously to a 
very wide range of network synthesis applications. The scope of their 
usefulness may depend upon the skill of the designer, as with any 
synthesis tools, but the underlying principles are reasonably simple. 
The most important principles are perhaps the following: 

\ Tehebychet® polynomial series in frequency may be related to a 
power series in a new variable z. When the Techebycheff polynomial 
series corresponds to a finite network gain or phase, the power series 
corresponds to an analytic function of z, quite similar in form to the 
network function of p, with singularities at z-plane mappings of the 
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Fig 14 Simulation of a coaxial cable attenuation—Attenuation at top useful 
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network singularities. This makes it possible to apply power series ap- 


proximation methods, in terms of z, to obtain approximations based on 
Tchebycheff polynomial series, in terms of frequency. 

‘“*Maximally flat” approximations in terms of z may be used to match 
the first m terms in the Tchebycheff polynomial series representing net- 
work gain or phase to the corresponding terms in the series representing 
assigned gain or phase. In this way, a Tchebycheff polynomial type of 
least squares approximation to the network function is made identical 
to the corresponding least squares approximation to the ideal function. 
The overall error, network function minus ideal function, is then the 
difference between the two least squares errors. 

The z-plane analysis may also be manipulated, in a quite different 
way, to approach an equal ripple type of approximation (which usually 
represents approximation in the Tchebycheff sense). The complications 
are such that applications have been limited to problems of certain 
quite special types. On the other hand, analysis of this sort has been 
found useful in clarifying various other ways of seeking equal ripple 
approximations. 
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\ com pa l frequency shift carrier tele graph system is de scribed which pro- 
mades channels in the voice range and above the voice. The channel ter- 
minal unil incor poral S arrange ments for handling TWX SU pt rvisory siq- 


nals and employs no electro magnetic relays 


INTRODUCTION 


Most short Bell System telegraph circuits, particularly those in the 
less-densely populated areas of the country, have customarily been 
operated over direct-current facilities obtained by compositing or sim- 
plexing physical telephone circuits. Many of these extend from a tele- 
graph repeater in a central office to another arranged as a subscriber set 
uid mounted in the knee-well of the customer’s teletypewriter table. 
Thus, for example, circuits are extended to Teletypewriter Exchange 
Service (TWX) subscribers located far from the switchboard. The TWX 
facilities are arranged to handle supervision as well as transmission. 
The form of supervision is identical to that obtained when local facilities 
are employed and hence uniform operating procedures are obtained at 
TWX. switchboards for all subscriber stations without regard to their 
geographical location. 

During and immediately following World War II, the growth of the 
Bell System’s telegraph business resulted in some shortage of de 
facilities. It was foreseen that this shortage would be rapidly intensi- 
fied by the use of new short-haul carrier telephone systems, such as 
type Nl, in providing telephone circuits without adding physical con- 
ductors. Moreover, many of the existing direct-current facilities would 
be absorbed to meet signaling needs for the rapid expansion of tele- 
phone toll dialing. It| therefore became evident that carrier telegraph 
methods must be adopted for relatively short hauls in fringe areas, 

Phe existing 40CL voice-frequency carrier telegraph system” ” was 


bbb 
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designed for application in large groups at telegraph central offices and 
for trunk-service operation over toll telephone eirecults employ ing stand- 
ard levels. It has proved very economical in this field. However, the 
very features which make for economy in large installations (such as 
amplitude modulation, common carrier supply and testing equipment, 
and standardized operating conditions) cause this equipment to be 
costly when it is applied a few channels at a time in outlying offices; 
these may not be equipped with either telegraph battery supplies or 
telegraph boards. Moreover, the 40C1] equipment, being a carrier-on- 
for-mark and carrier-off-for-space system, does not lend itself to the 
provision of TWX toll subscriber line supervision identical to that of 
local stations without the addition of rather complex and expensive 
supervisory applique circuits. Where TWX supervision is involved these 
supervisory circuits are required to generate and recognize supervisory 
signal patterns capable of-being distinguished from transmission space 
signals and communication breaks, which are long space signals. 

Consequently, it was decided to develop a new carrier telegraph 
system especially aimed at the needs of fringe areas. One of the problems 
to which much thought was given concerned the choice between ampli- 
tude-modulation and frequency-shift operation. A frequency-shift sys 
tem provides some reduction in the effect of noise and other interference 
on transmission and it is also less affected by rapid level changes. Al- 
though these advantages were attractive, it was not clear that they were 
sufficient to justify the added complexity and cost entailed by the 
adoption of this type of transmission, in view of the quiet and stable cir- 
cuits encountered in the Bell System plant. What finally swung the bal 
ance toa frequency-shift system was its advantage in handling TWX 
supervisory signals. With transmission accomplished by shifting the car- 
rier frequency, supervisory signals could be sent by turning the carrier 
on and off. A cheap and simple circuit might then be used to distinguish 
between transmission and supervision. 

From the foregoing discussion it will be evident that during the twelve 
years since the 40C] system was developed the needs of the Bell System 
have changed. Fortunately, the designer’s art has concurrently made 
great strides in making available new miniature apparatus and elec- 


tronic techniques such as have been exploited so successfully in the 


143A type electronic telegraph regenerative repeater,’ the V3 telephone 


repeater’ and the N-L carrier telephone system. As a result, the 
channel terminal of the new 43A1 carrier telegraph system, being small, 


inexpensive, self-contained and all-electronic with no electro-mechanical 
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relays, is almost ideally suited to the needs of the smaller central offices 
and TWX stations. 
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FREQUENCY ALLO¢ 





The 43A1 system provides two groups of channel-frequency alloca- 





tions, as follows: 





a A three-channel high-frequency allocation, using frequencies be- 





tween the upper edge of the voice-frequency band and the lower edge of 





the type-C carrier telephone band. This allocation is primarily for opera- 





tion on open-wire lines but can also be operated on cable circuits where 





the loading provides a suitably high cut-off. 
b A voice-frequency allocation capable of providing six channels 






on two-wire circuits or twelve channels on four-wire circuits. The chan- 





t nels of this allocation are for operation over telephone speech channels 





on any of the standard facilities, including broad-band carrier and cable 





or open-wire physical circuits 
The present frequency allocations are shown in Fig. 1. The voice- 







frequency system is based on twelve nominal midband frequencies 





spaced 170 eycles apart from 595 eyeles to 2635 cycles, omitting 1615 





eycles. The carrier frequency is shifted +35 cycles about midband, and 





either the higher or the lower frequency may be used for marking sig- 
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nals. The high-frequency system is based on six midband frequencies 
spaced from 200 to 240 cycles apart. The frequency shift ranges from 
+40 cycles in the lowest channel to +50 cycles in the highest. These 
wider spacings and shifts were adopted to ease the problem of designing 
inexpensive filters and oscillators for the higher frequencies. 

Channel | of the high-frequency system employs adjacent frequency 
assignments for the two directions of transmission. The lower frequency 
path employs a downward shift for marking signals and the higher- 
frequency path an upward shift for marking signals. In half-duplex 
operation this minimizes interference from the strong signals at the 
transmitter output to the weak signals at the receiver input. The steady 
marking frequency, which is being sent against the flow of traffic, is 
shifted away from the band over which the message is passing. 


CHANNEL TERMINAL CIRCUIT 
Sending Circuit 


The sending portion of the channel terminal circuit is shown in the 
upper part of Fig. 2. When the teletypewriter sending contacts open 
the loop to send a spacing signal, the sending triode is cut off. When the 
contacts close the loop to send a marking signal, the grid is made positive 
with respect to the cathode, the tube conducts and the potential at the 
plate is decreased. A varistor bridge modulator is connected between 
this plate and a source of potential having a value lying midway be- 
tween the marking and spacing plate potentials. Thus, the potential 
applied across the modulator during marking signals is opposite in 
polarity to that apphed during spacing signals. When the voltage across 
the varistor bridge is in the conducting direction, the varistors provide a 
low impedance path to alternating currents. Thus additional capacitance 
is coupled to the oscillator tank circuit and the oscillator operates at 
the lower of its two signal frequencies. When the voltage across the 
bridge is in the non-conducting direction, the varistors are biased to a 
high-impedance portion of their characteristic, the capacitor is effee- 
tively disconnected from the tank circuit and the oscillator operates 
at its higher signal frequency. 

The reversing switch in the driving circuit of the modulator permits 
either the higher or the lower frequency to be used for marking signals. 


The oscillator output power is adjusted by the SEND LEVEL poten- 
tiometer and passed through a buffer amplifier and a band pass filter 
to the send bus and line. 


The filter is an impedance transforming structure which contains a 
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downward transformation (7500:600) from the impedance of the buffer 
amplifier to that of the line so that no amplifier output transformer 
is required, 

Kither unity-ratio line coils or a hybrid coil may be used to connect 
the unbalanced sending and recelving filters to a balanced line. The 
hybrid coil is used with a two-wire line when the send and receive 
frequencies occupy adjacent bands. 


Receiving Circuit 


The receiving circuit, shown in the lower part of Fig. 2, is equipped 
with a filter which selects a narrow band of frequencies centered about 
the mark and space frequencies of the channel to be received. The 
receiving band filter has characteristics similar to those of the sending 
filter, except that it has a greater discrimination against unwanted fre- 
quencies and provides an upward transformation (600: 140,000) from 
the line impedance to a value suitable for driving the grid of the first 
amplifier stage. 

The frequency-loss characteristics of a typical receiving filter used in 
the voice band and of the corresponding sending filter are given in Fig. 3. 


The carrier signals selected by the receiving filter are passed through 


a three stage amplifier limiter. Most of the limiting action is provided by 


the third stage; the first and second stages act as amplifiers only for 
weak signals but limit strong signals. An adjustment for receiving gain 
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Fig. 3—Send and receive filter characteristies, VF allocation. 
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is provided between the first and second stages. With the REC GAIN 
control at maximum the third stage is driven to full output when the 
input to the receiving filter is greater than about —50 dbm*. Where it 
is not necessary to detect the presence or absence of carrier for super- 
vision as described below, the control is generally set for maximum gain. 

The limiter output is passed through a frequency discriminator con- 
sisting of two anti-resonant circuits in series, tuned so that one has a 
parallel resonance at the low frequency edge and the other at the high 
frequency edge of the channel band. The voltages appearing across the 
anti-resonant circuits are rectified separately by germanium. varistor 
diodes and the resultant d-c output voltages are added algebraically, 
filtered and applied to the control grids of the output tubes. 

Since at normal receiving levels the limiter removes all magnitude 
variations, the output from the discriminator detector circuit is depend- 
ent in magnitude and sign only on the signaling frequency. A negative 
voltage from the detector causes cut-off of the amplifier tubes and a 
positive voltage causes plate current to flow. A switch between the 
discriminator and the detector provides means for reversing the out- 
put connections of the discriminator so that a positive voltage from 
the detector can be obtained with either the higher or the lower. sig- 
naling frequency. Fig. 4 shows the de voltage output versus frequency 
characteristic obtained with a typical discriminator. 
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The low pass filter between the detector and last stage serves to 
remove carrier ripple and to decrease the effects of noise and other inter- 
ference having demodulated frequency components greater than about 
40 eps, which is slightly higher than the “dotting”? frequency of 100- 
word per minute signals. In order to prevent a change in the tuning of 
the discriminator when the reversing switch is operated, a balanced 
low-pass filter structure without mutual inductance is employed. This 
presents high and nearly equal impedances to ground from the positive 
and negative sides of the detector circuit. 

Nearly all the voltage gain of the receiver appears ahead of the 
detector. Since the detector output voltage applied to the grids of the 
beam power tetrodes is high enough to give an approximately square 
signal wave shape in the loop, no intermediate stage of de amplification 
is needed following the detector. For unbiased signal reception, the de- 
modulated signals should be centered on the grid characteristic of the 
receiving tubes; that is, the marking and spacing voltages applied to 
the grid cireuit should be symmetrical about a potential a few volts 
negative with respect to the receiving tube cathodes. To obviate the need 
for a voltage source negative with respect to the cathodes, the signals 
are prebiased by unbalancing the detector so that the mean of the mark 
and space output voltages from the low pass filter is about —5 volts. 
Further adjustment of the mean signal value may be made by means of 
the REC BIAS potentiometer to compensate for bias of signals received 
from the line due to deviations in the mark and space frequencies from 
their theoretical values or to other causes originating at the sending 
terminal of the telegraph circuit as well as for bias due to discrepancies 


in the discriminator network or to differences between mark and space 


levels. 

These arrangements permit great freedom in the assignment of loop 
battery voltages. The cathodes of the final stage may be fixed at — 130- 
volt, —48-volt or ground potential and the plates operated from ground, 
+48-volt or +130-volt potential. The remainder of the circuit may be 
powered by + 130-volt battery for the plates and —24-volt battery for 
the heaters of the tubes, regardless of the loop conditions. 

By means of the reversing switch mentioned above, current may be 
caused to flow in the loop during the reception of the higher or the lower 
frequency. Thus not only can various frequency allocations be accom- 
modated, but the local circuit may be operated neutral (current for mark) 
or inverse neutral (no current for mark). 

One tube is used in the final stage for 20 ma or 30 ma loop current, 
and two for 60 ma loop current. 
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Supe rvisSory Circuit 
When the channel is used in TWX. service as a toll subscriber line, 


the subseriber calls the operator to initiate a call by closing the power 


switch on his teletypewriter. This connects power to the teletypewriter 


motor, closes the transmission circuit to the teletypewriter and applies 


plate battery voltage to the transmitting oscillator in the channel ter- 
minal, resulting in the transmission of carrier current over the line. 
\t the distant (switchboard) terminal the receipt of carrier current 
energizes a supervisory signal receiving circuit which is responsive to 
earrier-on and carrier-off conditions in the receive band. In this circuit, 
Carrie! oltage appearing at the plate of the limiter tube ts rectified 
and applied to the grid of the supervisory triode. The operation of a 
relay in the plate circuit of this tube causes a line lamp at the switch- 
board to light 

\ disconnect signal is sent by the subseriber at the end of a call by 
opening the teletypewriter power switch. This removes the oscillator 
plate voltage. At the central office, the receipt of the resulting no-carrier 
signal de-cnergizes the supervisory receiving circult and causes the super- 
ISOry lamp in the operator’s cord circuit to light steadily. To recall 
the operator during a call the subscriber opens and recloses his power 
switch. This causes the cord lamp at the switchboard to flash. 

\n re circuit slows the rise of current in the supervisory receiving 
tube to guard against false operation of the switchboard line lamp due 
to noise impulses during the carrier-off, that is, the idle condition. 


DC Circuits 


On the de side of the channel terminal, provision is made for optional 
Wiring arrangements to connect to the circuits of the various telegraph 
test boards, service boards and TWX switchboards, as well as to local 
teletype writer loops, using telegraph voltages of either 130 or 48 volts. 
In offices where a negative 130-volt battery is not provided, operation 
with a single positive 180-volt battery is possible. 

he loop connections are made to an electronic circuit in the channel 
terminal which is similar to that employed in a recently-developed 
electronic loop repeater used in telegraph offices and which possesses 
several interesting features. Fig. 5 compares the action of this circuit, 
in transmitting toward the subscriber station, with that of more con- 

irrangements: 
a) shows a conventional open-and-close circuit and the wave shapes 


Which it produces at the central office end and at the far end of a capaci- 
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tative loop. As is well known, the asymmetrical wave shape causes 
positive signal bias. 

(b) shows an “effective polar” circuit along with the wave shapes it 
delivers. This is the circuit conventionally used to drive subscriber loops. 
It presents a constant low impedance to the loop and might therefore 
be considered a ‘‘close-and-close”’ circuit. 

(c) shows the electronic loop circuit. The driving tetrodes are operated 
in their high-impedance region, above the knee of the plate-current 
plate-voltage curve. They deliver a highly symmetrical rectangular 
wave to the loop and little or no bias results. This circuit presents a 
nearly constant high impedance to the loop and might be considered 
an “open-and-open”’ circuit. 

Although the rectangular wave is inferior to a peaked wave in that 
less average power is delivered for the same values of steady-state cur- 
rent and voltage, it provides entirely acceptable transmission for 19 
gauge cable loops up to about 20 to 25 miles in length. Inasmuch as 80 
volts potential is absorbed in the electron tube plate circuits, this is 
almost the maximum length over which 62.5 ma can be supplied when 
loop battery of 260 volts is used. 
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‘OPEN AND OPEN” CIRCUIT 


Explanation of electronic loop circuit 
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During open-and-close transmission by the subscriber, the high im- 
pedance termination of the loop at the tetrode plate circuits causes the 
current at the central office end of the loop to change very slowly—too 
slowly for good transmission at teletypewriter speeds. However, the 
voltage wave is very well shaped, and this is what is used to drive the 
grid of the transmitting tube. One noteworthy fact is that the bias of 
the signals repeated from loop to line is nearly independent of loop length; 
consequently no inductive wave shaping is required at the subscriber 
station, even in the longest operable loops. 

Because of the high impedance termination, loop current is Insensitive 
to circuit resistance. The loop padding rheostat is, therefore, adjusted 
to build out the loop resistance to a standard value and the amount of 
loop current required for proper operation of the station teletypewriter 
is obtained by varying the screen grid potential of the tetrode tubes. 


Dupli ur Feature 


In halt duplex operation, one de loop at each channel terminal serves 
for both sending and receiving. The central office end of this loop is 
connected to the grid of the sending triode and to the plates of the re- 
ceiving tetrodes. If a marking signal is being received from the carrier 
line while the teletypewriter contacts in the loop are closed, the receiving 
tubes conduct, current flows in the loop and the teletypewriter in the 
loop receives a marking signal. Under this condition the office end of 
the loop is positive with respect to the cathode of the sending triode; 
hence this tube passes a marking signal toward the carrier line. When a 
spacing signal is received from the carrier line the tetrodes are cut off, 
the loop current is reduced practically to zero, the teletypewriter re- 
ceives a spacing signal and the voltage at the office end of the loop be- 
comes more positive. Hence a marking signal continues to be transmitted 
to the line during the receipt of either mark or space signals from the 
line 

When the subseriber opens the loop to send a spacing signal to the 
distant terminal, the potential of the sending triode grid becomes nega- 
tive with respect to its cathode, the tube cuts off and hence, as described 
previously, a spacing frequency is passed to the ac line. 

In full-duplex operation, two loops are provided at each channel 
terminal to permit sending and receiving simultaneously. The grid of 
the sending tube is disconnected from the plates of the tetrodes and 
transferred to a resistive connection which terminates the full-duplex 


sending loop. The loop circuits operate in the same way as described 


for half-duplex operation except that no break action is provided. 
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Break Feature 


When the subscriber opens the loop at the teletypewriter to break 
transmission coming from the distant terminal, a clean-cut space should 
be transmitted to the line regardless of any incoming signals. The re- 
sistor shunted between the plates and cathodes of the receiving tubes 
causes the central office end of the open loop to assume the same potential 


as the tetrode cathodes. This insures that a steady spacing potential 


will be applied to the send tube even though the tetrodes are cut off 
by an incoming space. This provides a rapid, clean break. However, if 
a large leakage exists across the loop conductors, the resistor will not be 
able to keep the sending tube in a cut-off condition and a break by the 
subscriber will result in the incoming transmission being reflected in an 
inverted condition to the distant carrier terminal. In such a case the 
distant sending subscriber would be broken by a “bust-up” of local 
copy or by operation of the keyboard break lock. This would normally 
be caused only by a trouble condition in cable loops. 

If a break signal is received over the line from the distant end while 
the near end subscriber is sending, his loop current is reduced to prac 
tically zero. This operates the keyboard break lock thus breaking the 
subscriber. This circuit differs from the conventional loop circuit in 
that the receipt of a break signal does not stop the outgoing signals 
except via the break lock. 


TELEGRAPH DISTORTION 


On quiet circuits, total distortion per section averages | to 2 per cent 
at 60 words per minute and about 5 per cent at 100 words per minute. 
Plots of received signal distortion versus level of received carrier are 
shown on Fig. 6 for both signaling speeds. 


EQUIPMENT FEATURES 


The channel terminal employs a formed sheet-metal framework and 
occupies a space 103 inches high, 5} inches wide and 7} inches deep over- 
all. Fig. 7 shows a 43A1 channel terminal. It is plug-terminated, and 
hence removable for maintenance or repair at a bench. 

The basic portion of the channel terminal is common to all frequency 
allocations. The oscillator network and send filter, which constitute the 
elements determining the transmitted frequency, form a plug-termi- 
nated sub-assembly 7} inches high, 53 inches wide, and 1} inches deep. 
The receive filter and discriminator, which select the received frequency, 
form a plug-terminated sub-assembly of the same size. 
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\ rear view of the channel terminal with the send frequency unit 
removed is shown in Fig. & With both frequency units in place, the 
rear of the channel terminal is almost: completely enclosed. When they 
we removed, the wiring and apparatus terminals of the basic channel 
terminal are readily accessible for test and repalr, 

ube sockets, potentiometers, test points, switches and the inductor 
of the low-pass filter are mounted on the front panel. Small resistors, 
capacitors, and germanium diodes are assembled on a plastic “ladder” 
vhich is mounted vertically in the space between the frequency units. 

\s shown in Fig. 9, three channel terminals may be mounted abreast 
on a welded metal frame which is fastened to any of the standard bay 
frameworks designed to accommodate 19-inch mounting plates. The 
unit mounting frame carries the multicontact receptacles into which the 
channel terminals are plugged. Twenty-four channel terminals may be 
mounted on an 11}-foot relay rack, with line coils and certain auxiliary 
equipment 

Where arrangements for switching between half and full-duplex opera- 
tion are required, duplex switches for a number of channel terminals 
are mounted on a narrow plate between the channel terminal mounting 
IPAMeEWOPKS 


Loop rheostats, when required, may be mounted adjacent to the 


channel terminals or in a loop pad bay along with other loop rheostats 


that may be associated with electronic loop repeaters. The latter arrange- 
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ment concentrates the heat dissipated by these rheostats at a place 
where it will not be harmful. 


Subscriber Set 


A channel terminal may also be mounted in a station set box appear- 


ing in the knee-well of a subscriber’s teletypewriter table. This, called 
a 130B1 teletypewriter subscriber set, is illustrated in Fig. 10. It con- 
tains a line or hybrid coil and balancing network, as well as local cireuit 
resistors and other miscellaneous apparatus. When so mounted, the 
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Fig. 7—Channel terminal, front view 
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Fig. 8—Channel terminal, rear view, sending network removed. 
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Fig. 10—130B1 teletypewriter subscriber set including channel terminal 


channel terminal is powered by the teletypewriter rectifier, which fur- 
nishes 130-volt de and 20-volt ac power. 

The 130B1 set may be employed in private-line or TWX. service. 
In the latter, the application and removal of oscillator plate battery is 
controlled as described above by the teletypewriter power switch, so 


that the equivalent of telephone ‘“‘switch-hook”’ supervision is attained. 


Supervision and transmission are largely independent. The telegraph 
receiving circuit at the central office terminal remains marking during 
recall and disconnect signals; hence these supervisory signals do not 
pass through the cord-circuit repeater to the TWX toll line. Since there 
is no frequency discrimination in the supervisory receiving circuit, 
either marking or spacing carrier from the station energizes the super- 
visory circuit. Hence a communication break (spacing) signal from the 
subscriber station is transmitted through the operator’s cord without 
any effect on the supervision. 

On a TWX call to the subseriber station, a series of alternate marks 
and spaces, generated by applying 20-cycle ringing voltage to the grid 
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of the sending tube at the central office terminal, actuates the station 
ringer, Which is connected to the local loop whenever the teletypewriter 
power switch is in the OFF position. 

The circuit which terminates the TWX toll subscriber line at the 
switchboard office is operable with all existing types of TWX cord cir- 
cuit repeater. All the features of TWX service, including unattended 


‘vice, are therefore available. 
POWER DRAINS 


\ channel terminal dissipates about 25 watts. Tube heaters consume 
about half an ampere at 24 volts and the remainder of the channel term- 
inal, exclusive of its loop-terminating portion, consumes 50 ma at 130 
volts. The loop terminating portion dissipates 20, 30 or 62.5 ma at 80 
volts, depending upon the type of local circuit employed. 


LINE LEVELS 


The 43A1 system is capable of working with a great variety of line 
levels. The send level may be adjusted for any value from +6 dbm 
downward, The receiving equipment operates satisfactorily with —45 


dbm or even —50 dbm. But the levels actually used are controlled by 


crosstalk and noise conditions in the line. 

Receiving levels are normally limited by lightning interference on 
open wire and by noise on cable circuits. The minimum tolerable levels 
are about —40 dbm on open wire, —45 dbm on four-wire cable circuits 
and —35 dbm on two-wire cable. 

In Fig. 11, a comparison is made of the effects of static on the 43A1 
system and on the 40C) amplitude-modulation system. It gives the 
results of simultaneous tests on the 2465-cyele bands of the two systems, 
using the static from a record made at Madison, Florida. The 43A1 
channel could tolerate about 4 db stronger static than the 40C. 


SYSTEM LAYOUTS 


\ typical circuit layout of the 43A1 system working in the frequency 
band between the voice and type-C carrier on an open-wire line is shown 
in Fig. 12. The telegraph circuits extend from 43A1 channel terminals 
located in a central office, at the left, to L3O0BI1 sets in subscriber stations, 
at the right. In the central office, the send and receive paths of the chan- 
nel terminal are combined ina hvbrid coil. With the moderate degree of 
balance provided by the network of this hybrid coil, the allowable dif- 
ference between send and receive levels of the middle channel may be 
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Fig. 11—Comparison of amplitude and frequency shift modulation with static 


interference 

35 db or more. The telegraph channels are next combined with the voice 
frequency circuit by means of a 150A filter, and are connected to the 
composite set and line through the low-pass section of the 121A (type 
-C) carrier line filter. As a result of the cut-offs of the 150A high-pass 
and 121A low-pass filter components, the pass band of the telegraph is 
about 3.7 to 5.4ke. At the outlying terminal of the open-wire line, the 
telegraph is separated from the voice and type-C carrier circuits by 
similar filters and connected to the individual subscriber stations by a 
branching network and branch lines. 

The typical arrangement on a two-wire circuit in the voice frequency 
range is shown in Fig. 13. Six channels are available, using six of the 
twelve frequency bands for transmission east to west and the other six 
bands west to east. As in the high frequency case, a branching network 
and branch lines at the outlying end connect the circuits to the sub 
scribers. Fig. 14 shows a layout in which branch lines are connected at 
intermediate points in the telephone circuit. At these intermediate points 


the impedance of the branching network is made high, in order to keep 


the balance at the telephone repeater from being harmed excessively. 
Though the network attenuates greatly the signals through it, the tele- 
graph level is usually sufficiently high so that this loss can be tolerated. 
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The branching network at the outlying terminal has low impedance. 


Taps on the transformers in the network permit the impedance ratios 






to be adjusted to suit the line impedances between which the network 






operates. Since several circuits may pass through this network, a short- 
} : £ 






circuit on one branch should not be capable of degrading transmission 






in the other branches. To prevent this, resistances are inserted in series 


i 






with each branch of such a value that a short circuit will not cause more 






than 3 db excess loss in other channels. [t has been shown by tests that, 
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in this frequency-modulation system, a sudden loss of 3 db causes little 
distortion. The series resistances may serve another purpose besides 
protecting against short circuits. If one branch has a much greater at 
tenuation than the others, the resistance values in series with the shorter 
branches may be increased so that more energy is directed into the longer 
branch. 


Emergency Circuits 


If a circuit containing no intermediate branches fails, a regular mes- 
sage circuit can be patched in to replace it until the trouble is cleared. 
Fig. 15 shows trunks to be used for making this patch in the case of two 
wire circuits. They contain 3 db pads which reduce the signal level to 
compensate for the change from 0 db transmission level on the regular 
line to +3 db level on the message circuit. 

The 43A1 system may operate also over a four-wire circuit, which 


accommodates twelve telegraph channels. A patch to an emergency mes- 


sage circuit would then be made at the four-wire patch bay. Since the 
circuit used for telegraph would usually be similar to those used for tele- 
phone message service, no pads to adjust levels would be required for this 
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patch Obviously echo suppressors must be disabled when a message 
circuit is used for telegraph. 

When the telegraph circuit contains one or more branches at inter- 
mediate points, it would be difficult and often impractical to use an 
ordinary message circuit to replace the telegraph stem in emergencies. 
The branching location frequently will not be manned and so no one 
will be available to patch the branch line to the message circuit. In such 
eases each intermediate branch circuit may be made good over a separate 
message circuit which is individual to it. Fig. 16 shows this arrangement. 
\ patch trunk is provided between the 43A1 channel terminal at the 
central office and the telephone switchboard. At the switchboard which 
is nearest to the intermediate branch subscriber, the branch line is 
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earried through a cut-off jack. The toll operators then can patch the 
circuit to the subscriber, thus by-passing the main line when it is in 
trouble. Since the telegraph energy from only one channel is impressed 
on the emergency circuit, no adjustment of levels is required. 

The channel terminals which are at the central office, shown at the 
left of Figs. 12 to 16, may be connected to subscribers over de loops or 
they may be connected to other types of telegraph repeaters. Fig. 17 


indicates the latter connection schematically. Since the loop circuit must 


supply positive potential to the 43A1 channel terminal, the connecting 


repeater must be arranged to supply positive battery for marking signals. 


FUTURE EXTENSIONS 


It is expected that the field of application of the 43A1 system will be 
broadened by further development over the next few years. More fre 
quencies will be proy ided, both in and above the voice band. Means will 
be designed for passing TWX supervisory signals over a direct-current 
loop from a subscriber station to a channel terminal installed in a nearby 
central office. The built-in supervisory arrangements of the 43A1 equip- 
ment will be exploited to obtain inexpensive straightforward trunks 
for use both between TWX. switchboards and from switchboards to 
Line Concentrating Units. The supervisory feature will also be employed 
in private line service to provide an open circuit alarm. 
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The Ty pe-O Carrier System 
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INTRODUCTION 


While the sight of an open-wire toll line is a rarity in many parts of 
the East, considerable use is made of open-wire facilities in other sections 
of the country to provide toll and exchange service. At the present 
time there are about 170,000-route-miles of open-wire in the Bell System 
which carry some 1,400,000 pair-miles of wire used for toll service. It is 
estimated that about 60 per cent of this pair-mileage is used for carrier, 
although only about 10 per cent carries the full fifteen carrier channels, 
which is possible by employing type-C and type-J carrier systems. It 
is obvious that some of the remaining line pairs are available for addi- 
tional carrie growth, provided, of course, the demand for additional 
circuits exists, and there are carrier systems which can meet these de- 
mands economically. Type © is a multi-channel, open-wire carrier sys- 
tem which has been designed to pro\ ide, economically, additional circuits 
in the range from a minimum of about 15 up to a maximum of 150 miles, 
or more. The type-O system is the open-wire counterpart of the type N 
short-haul cable system. 

Present open-wire toll lines vary from a single-arm line, with one or 
two pairs of wires, up to lines with five or six arms carrying thirty pairs. 
These lines may carry long-haul toll circuits up to about 1000 miles in 
length, short-haul toll cireuits up to 150 miles, as well as tributary trunks 
and exchange circuits. Growth in the past of toll and tributary circuits 
on these lines has been provided by the addition of single-channel D or 
H systems, three-channel C systems, twelve-channel J systems or by 
other similar carrier systems. 

The full development of a line for open-wire carrier has, in the past, 
required expensive line rearrangements. For instance, most lines reach 
terminal and repeater offices over entrance cables which may be several 
nviles in length. Impedance matching at the junction of the open-wire 
and cable is required, and is provided by loading the cable at both voice 
and carrier frequencies, by employing junction line filters using non- 
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loaded carrier pairs, or by the use of autotransformers. In addition, 
transposition schemes are needed to reduce the crosstalk coupling be- 
tween open-wire pairs to tolerable amounts, and longitudinal and metallic 
filtering is necessary at repeater points to control interaction crosstalk. 
The C and J carriers have been designed essentially for long-haul use, 
and when the line transposition costs are added, these systems are likely 
to be more expensive than adding wire for providing relief for the shorter 
circuits, Which are required in increasing number as the length decreases. 

In contrast to the heavy back-bone toll lead carrying both long and 


short haul circuits is the one or two arm line which may be a secondary 


route, or a line which terminates in a small town. The demands along 
this line are for short-haul toll service, trunks between tributary offices 
and their toll centers, and for exchange service. Because growth has 
been relatively slow, carrier has been employed only to a limited extent. 
Single-channel D or H systems may be found on these lines, or an adapta- 
tion of the M system for toll service, and possibly other miscellaneous 
systems. Only minor rearrangements of the line and entrance cables 
has been necessary because of the small percentage of circuits equipped 
with carrier facilities. 

A typical need for expansion on this type of line occurs when a manual 
tributary office is cut over to dial operation, and the operators are moved 
to the toll center. Additional circuits are immediately needed from the 
toll center to the tributary office because of certain factors introduced 
when the operators are moved some miles away. Experience has shown 
the desirability of being able to reach an operator a fairly large percent- 
age of the time because of special services, such as directory information, 
reports on the availability of toll circuits, service complaints, ete. This 
requires a substantial increase in the number of circuits to the tributary 
office in such instances. Development of this line, then, proceeds by 
adding single-channel carrier systems, until a point is reached where it 
is necessary to string more copper wire, Which is costly and may be in 
short supply, or to add multi-channel carrier systems. 

The situation in Lowa is typical of many areas in the Southern and 
Western parts of the country. Fig. | shows the principal open-wire and 
cable routes in lowa used by the Bell System for toll business. The 
type-IX transcontinental cable crosses the state, passing through Daven- 
port and Des Moines on its way to Omaha. Small branch cables serve 
Muscatine, Cedar Rapids and Atlantic, where the circuits are extended 
by open-wire facilities. In general, the transcontinental TD-2 radio relay 
system follows the KX carrier route. A coaxial cable route extends north 
from Des Moines to Minneapolis, connecting at Towa Falls with short 
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K cables to Fort Dodge and Waterloo. Eventually a second cable route 
will extend across the state through Waterloo and Fort Dodge, as shown 
by the dashed lines. A second coaxial route cuts across the southwestern 
corner on its way to Kansas City and a third coaxial route connects 
Sioux City with Omaha. The rest of the state is served by open-wire 
lines, 

Fig. 2 shows the distribution with length of the Bell System open-wire 
short-haul toll and tributary circuits in Towa in 1950, including both 
voice-frequency and carrier facilities. [It will be noted that 95 per cent 
of the circuits are less than 100 miles in length, while 90 per cent are 
less than 70 miles, the point where type C systems just become economi- 
cal. For tributary circuits 98 per cent are less than 30 miles in length. 
There are a total of some 2700 toll and tributary circuits in Towa. In 
addition, there is also a sizable connecting company development. Fig. 
3 is a distribution of the number of circuits per group, where a group is 
composed of the circuits used for via or terminating business between 
two towns. There are about four circuits per group for short-haul toll 
and two circuits per group for tributary service in the median case. As 


the dial conversion program proceeds the average number of circuits per 


tributary group is expected to increase. 

Because of the short distances involved, and the small number of 
circuits per group, carrier development in Iowa has been restricted, to a 
large extent, to single-channel systems, and type M. Only four or five M 
channels can be operated on a given open wire line, and while these 
systems have some transmission disadvantages, they have been employed 
to a large extent. However, further M development is blocked because of 
the expense of isolating M systems from adjacent lines. There are a few 
C systems on such routes as Sioux City-Spencer-Mason City, Waterloo- 
Dubuque, Muscatine-Keokuk, and Atlantic-Spencer. 

The type-O system, therefore, is being made available to provide 
short-haul toll and tributary circuits on open-wire lines in the range 
from 15 to 150 miles. When completely developed it will provide four 
four-channel systems in the frequency range from 2 to 156 ke, as shown 
on Fig. i. The use for separate channels ol both sidebands of u single 
carrier, called a ‘“twin-channel,” results in economical use of the fre 
quency space. The four channel systems are designated OA, OB, OC, and 
OD respectively, and cover substantially the same frequency range as 
the C and J systems. 

Considerable attention has been given to keeping the line rearrange 
ments as simple as possible. The use of non-loaded entrance cable is 


proposed, and simple arrangements are available for adding O groups 
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above existing carrier systems, such as C, which has a top frequency of 
30 ke. With the aid of the compandor, it is possible to apply the OB 
system to practically any open-wire pair transposed for C carrier opera- 
tion, thus nearly doubling the number of circuits without additional line 
rearrangements. Transposition arrangements which are expected to be 
less expensive to apply are being made available where the higher- 
frequency type-O groups are involved. Line losses of the order of 35 to 
10 db can be spanned under normal wet weather conditions, and 50 db 
loss under sleet conditions with some transmission impairment, since 
sleet is relatively infrequent in occurrence. This will result in repeater 
spacings of the order of 50 miles in sleet areas for the OB group, and 100 
miles in other areas. For the higher frequency groups (OC and OD) these 
spacings will be approximately halved. 


CHOICE OF DEVELOPMENT APPROACH 


The type-O carrier system followed the type-N system closely in 


time, and, in effect, covers the same range of circuit lengths for open 


wire lines that N provides for cables. It was both natural and expedient 
that many of the N features were carried over directly into the O design 
It was necessary, however, to make important distinctions as well. These 
similarities and differences will be discussed in some detail. 

The transmitting and receiving voice frequency subassemblies are 
reused with substantially no modification. This provides the O system 
with the same compandor and the same 3700 cycle signaling system as 
used in N. 

An important difference between the two systems is concerned with 
the use of single sideband in the O rather than double sideband as in 
the N. This choice is an economic one. The double sideband system is 
relatively easier to design and less expensive than the single sideband 
arrangement. The use of double sideband in cables is practicable in 
many cables because of the relative abundance of conductors as com- 
pared with open wire pairs. In some cases the use of single sideband in 
cables may be attractive as compared with the cost of new outside plant 
for certain length ranges. 

Another distinction between the two systems is the provision of cir- 
cuits in smaller groups in O. In N the basic group is 12, although systems 
may in some instances be partially equipped. In O, the desire to furnish 
smaller circuits groups resulted in the choice of a basic four-channel 
group. The full complement per pair for O, including a channel replacing 
the voice circuit, is sixteen channels. 

The regulation problem is more severe in the O design. It is necessary 
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to provide sufficient regulator range to accommodate line variations due 
to wet or 1ey lines. The repeater and receiving group regulator range 
common to four channels is in the order of 40 to 50 db, or approximately 
four times the regulating range of an N repeater. The range of the 
twin-channel regulator is comparable to the N individual channel regu- 
lator, but the O regulator is shared by two channels forming adjacent 
-idebands of the same carrier. 

The use of a single sideband imposes more severe requirements on 
channel band filters. The use of a material called ferrite, in combination 
vith a erystal, affords an efficient channel band filter in a small space 
when compared to previous single sideband channel filters employing 
ur-core coils. Ferrite coils are emploved In a coil-condenser type of filter 
to provide separation for the various four-channel groups. While the N 
system employs only receiving channel band filters, O has filters in 
hoth the transmitting and receiving terminals. 

Phe O system employs the double modulation principle for all groups. 
This arrangement permits the use of only four channel band filter de- 
signs tor all ol the 32 channel lrequency allocations. The frequency range 
for these basie channel bands has been selected to proy ide the most 
economical overall filter design. 

Phe use of lie castings has been extended in a number ot Ways. No- 
table among these is a die-cast framework, used in both the terminal 
and the repeater. The plug-in technique has been expanded to provide 
plug-in filters for channel and group band filters. 


DESCRIPTION OF THE SYSTEM 


The sVvstem will he deseribed first by block schematics, second, by 


transmission characteristics, and finally by photographs. This descrip- 


tion will show representative features rather than describe the system 
( omple tely 

While the description will cover the complete O plan, it should be 
pointed out that the OB system is the first to be made available. It will 
be followed by the other O systems. 

In the schematic description, where a unit is common to all systems 
the designation is “Type 0.” Where the arrangement is different for 


several svstems, a particular designation is used, such as “Type 


The O modulation plan is shown on Fig. 5. The single-sideband chan- 


for all groups are in the frequency range from 180 to 196 ke. 
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By the use of different group carrier frequencies the several four-channel 
groups are placed in their various locations. As indicated by Figs. 4 and 
5, high and low group assignments are used for the two directions of 
each four-channel system. A repeater is provided for each four-channel 
system and, except in the case of OA, the high and low frequency groups 
are “‘frogged”’ at each repeater, as in the N system 

Figure 6 shows a block diagram of a complete O system. On this figure, 
and in general on other figures showing filters, a letter code is assigned 
to designate the kind of filter, with a subscript letter to indicate the 
particular system in which the filter is used. The several filter designa- 
tions and number codes are collected for reference in Table I. Much of 
the apparent complexity of the system, particularly as regards filters, 


arises out of the use of a single pair for both directions of transmission. 


Another complexity is occasioned by the requirement that a complete 


complement of O systems will not always be provided. For example, 
OB, OC, and OD systems may be used above an existing C system, or 
similar systems. 
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Fig. 5—Type-O modulation plan. 
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Line filters (GQ) are provided to separate the OB, OC, and OD Systems 
from the OA frequency ranges. Because of the lower attenuation and 
slope in the OA frequency range, and the better line coupling factors, 
the repeaters do not “frog” the high and low groups. 
The OB Carrier Terminal 


A block diagram of a typical carrier terminal is shown on Fig. 7, 
in this case the OB terminal. The terminal is comprised of four channel 
units, two twin-channel units, group transmitting and receiving units 
and a group oscillator. An oscillator in each of the twin channel units 
supplies carrier to the transmitting channel modulators. The same oscil 
lator supplies transmitted carrier for two associated sidebands. The 
original carrier is balanced out in the transmitting modulator. This 
method results in a more accurate control of the transmitted carrier 


level. The group oscillators supply the necessary frequencies to the 


TABLE | 


TERMINAL ONLY 

Transmitting low pass None 16SF 

teceiving low pass None 169G 

Carrier pickoff (184ke Fl 532A 

Carrier pickoff (192ke F2 532B 

Signal pickoff None L69A 

Channel band pass None 529A 

Channel barid pass None 529B 

Group transmitting LD 5AOA* 

Group receiving A+ D 530J 531B 530C | 5301] 

Group receiving B+ D 531k 531C =530D ) 530G 
TERMINAL AND REPEATER 

Directional : ; 530H 530A 530B 5301 

G2 219S8t 
Line + (Gl 537At 
Gil 538A 

{EPEATER ONLY 

Auxiliary 531D 
\ 530K 
B 530L 


* Except OA system apart region between 36 and 40 ke. { Cut 


; 
region between 30 and 40 ke 


apart 
538A is a 537A filter with housing and protectors 


for pole mounting 
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transmitting and receiving group units to translate the sidebands be- 
tween the frequency range of the channel band filters and the correct line 
frequency allocation. The group receiving unit contains the directional! 
filter for separating the four-channel transmitting and receiving groups 
at line frequencies. Multiple points are indicated for the connection of 
other O carrier systems on the same pair. 


Channel Unit 


A block diagram of the channel unit is shown on Fig. 8. As indicated 
by the dashed line, the channel unit is comprised of four parts which 
are interconnected by plugs and jacks. These are: 

1. The Compressor Sub-Assembly. This unit contains the compressor 
and a terminating arrangement to permit the system to be used for 
four-wire termination, or for two-wire termination at non-gain locations, 
i.e., those without switching pad control. 

2. The Expandor Sub-Assembly. This unit contains the expandor as 
well as the signal transmitting and receiving equipment. 

3. The Carrier Frequency Sub-Assembly. This unit contains the trans 
mitting and receiving modulators, and is arranged to receive the plug-in 
transmitting and receiving channel band filters. 

1. The Transmitting and Receiving Band Filters. These are combined 
in a single plug-in unit. 

Items | and 2 are practially identical to the corresponding sub-assem- 


blies for N carrier. Each channel receives its carrier supply for the trans- 


mitting side from an oscillator in the twin channel unit. On the receiving 
side the carrier is obtained by selecting and amplifying the transmitted 
carrier. 

The frequencies indicated on Fig. 8 are the same for all O systems, and 
apply to two of the four channels in the group. Figs. 4 and 5 show go and 
return channels in high and low frequency assignments in the same © 
system. However, as shown on Fig. 9 covering the OB system, the fre 
quency assignments applying to the channel band filters are above any 
of the © line frequencies and are in the frequency range from 180 to 196 
ke for both transmitting and receiving channel band filters. 

Transmitting and receiving channel band filters are paired in a single 
plug-in unit. In order to reduce the number of kinds of paired channel 
band filters (transmitting and receiving in the same plug-in unit) the 
pairing has been done in a special way. If, for example, transmitting 
assignment 180-184 were paired with receiving assignment 180-184, 
ete., four different kinds of paired filters would result. Instead, assign 
ment 180-184 is paired with assignment 192-196, and by making the 
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plug in filter reversible in its socket, this grouping ean he made to serve 
two channels as follows: 
1SO- 184 ‘Transmitting 192-196 Transmitting 
192-196 Receiving and ISO-IS4 Receiving 
A similar paired filter serves 
IS4-ISS ‘Transmitting ISS-192 Transmitting 
) ISS-192 Receiving >and 5 IS4—-1ISS Receiving 
Thus only two basic kinds of paired channel band filters are required, 
rather than four kinds. In these filters, as well as the reversible group 


filters, the filter designations are so arranged that when the filter is in 


place the proper filter designation is in view. 


Twin Channel Unit 


The twin channel unit is shown in somewhat more detail in Fig. 10. 
There are two kinds of twin channel units toserve the four channel assign- 
ments, and the frequencies shown on Fig. 10 correspond to those shown 
on Fig. 8. (and Fig. 9). A transmitting carrier adjustment permits the 
transmitted carrier level to be set properly in relation to the sideband 
levels. In order that the group regulators may function primarily on 
the carrier, and thus be substantially independent of voice or signaling 
sidebands, the carrier is transmitted approximately 6 db above the side- 
band level. 

On the receiving side of the twin channel unit a regulating amplifier 
controls the received level of both sidebands. It does this from the carrier 

CHANNEL TERMINAL GR 


LINE FREQUENCIES IN KILOCYCLES FREQUENCIES IN KILO 
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pie ked off by a narrow band crystal filter, This same carrier 1s supplied 
to the receiving side of the channel units for demodulating the associated 
<icle beans 


(rroup Transmitting { nit 


The OB group transmitting unit is shown on Figure 11. It receives the 
four sidebands and two transmitted carriers and places them in the 


proper high, or low line frequency assignment. The transmitting group 


init, depending on the optional connection to the group oscillator (Fig. 


11), can be either a high group transmitting unit or a low group trans- 
miitting tural 

For convenience the noise generator is contained in the group trans- 
mitting unit. On very quiet circuits this noise source provides a means of 
masking crosstalk. In ordinary usage the noise thus provided is not 
noticeable on the cireuit, but is sufficient to reduce the chance of hearing 
intelligible crosstalk to a small value 


Group Reece wing Unit 


The OB group receiving unit is shown on Fig. 12. It is comprised of 
an amplifier and a regulator-modulator arrangement equipped with plug- 
in filters. The same basic arrangement is used for all receiving group 
units, as well as for all repeaters. Only the plug-in filters, and the fre- 


quencies Trom the associated oscillators are different. The directional 
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filter is reversible as well as plug-in and thus serves either high or low 
groups. The receiving group band filter and its associated auxiliary filter 
have the same physical arrangement as in the repeater but they are 
never reversed, 

A de feedback type regulator controls the gain of the regulating ampli- 
fier, and operates principally on the two received carriers, although the 
sidebands are fed back also. 


Group Oscillator 


The group oscillator contains two oscillators for supplying the group 
transmitting and group receiving units. These oscillators are interchange- 
able (by strapping) and permit the group units to operate in either the 
high or low groups. For conveneince the 3700 cycle signaling oscillator, 
common to all four channels, is contained in the group oscillator. 


Re peater 


As indicated on Figs. 5 and 6, a repeater is provided for each four- 
channel system. An amplifier, regulator and modulator arrangement 
serves each direction. The directional bands are routed through the 
repeater by directional and auxiliary band pass filters as indicated on 
Figs. 13 and 14. At each repeater (except OA) the high- and low-fre- 
quency groups are “frogged”’ to improve transmission, particularly as 
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Fig. 11—Type-OB group transmitting unit and group oscillator unit 
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regards automatic equalization of attenuation slope with frequency, and 
to obviate the necessity for additional line treatment. 

Some repeaters receive low group frequencies and transmit high group 
frequencies for both directions. Other repeaters receive high group fre- 
quencies and transmit low group frequencies, In N two kinds of repeaters 
were required, In O the reversal of the filters in their sockets provides 
both kinds of repeaters, and presents the proper designation to view. 
\ regulator Is provided in each direction of the same kind as in the 
group receiving unit, 

It should be noted at this point that the filters internal to the repeater 
as opposed to directional filters) differ from the filters used in the re 
ceiving group units. This is because the repeater always accommodates 
line frequencies on both sides of the amplifier, while the receiving group 
unit accommodates line frequencies Oh one side (which correspond to 
the repeater line frequencies) but always must supply channel band 
filter frequencies at the group amplifier output. 

ig. 14 shows in somewhat greater detail than Fig. 13 the filter arrange- 
ment for an OB repeater 


PRANSMISSION CHARACTERISTICS 


The overall channel band width is illustrated in Fig. 15. The approxi- 
mate frequency cutoffs are similar to N but for various reasons the 
several channels may show somewhat greater differences. The O sys- 
tem, being a single sideband system, has a filter cutoff at low (voice) 


frequencies, Which the N does not have. Differences may exist between 
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Fig. 15-—Net loss frequency charactieristic 


upper and lower sideband filters. In addition, O has transmitting band 
filters while N does not. 

A situation is of interest which applies to both N and O, as well as 
to any other system employing the type of compandor controlled from 
the voice energy. Different frequency characteristics will be obtained 
with the compandor operating and with the compandor controls locked. 
Neither of these necessarily corresponds to the operating condition with 
speech or music. With the compandor controls free and using single 
frequency test tone, the characteristic obtained is a combination of the 
frequency characteristics of the line and control circuits. With the con- 
trols locked, the characteristic is that of the line only. If the control 
circuit is substantially flat, there will be little distinction between the 
measurements. The curve of Fig 15 is of the type obtained with free 
controls and with a substantially flat control circuit. 

A typical overall channel load characteristic is shown on Fig. 16. This 
characteristic includes not only the load curve of various amplifiers, 
modulators, ete., but shows also the order of match of the compressor 
and expandor load characteristics. This is a match of curves having 
2:1 slopes on a db basis over a wide range of volumes. 

A typical overall net loss variation for a non-repeatered circuit is 
shown on Fig. 17. Principally because of the line regulator in the group 
receiving units (Fig. 18) a wide range of line loss is covered. A similar 
regulator is included in each repeater, and the extension of a system 
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Fig. 16—Typical over-all channel load characteristic. 


with repeaters will not result in a substantial change of the net loss 
Variation, assuming the repeater section losses do not exceed the range 
of the regulators. 


i alas 


The line regulator is assisted by the twin channel regulator, for which 


a characteristic is shown on Fig. 19. This regulator is similar to the 
individual channel regulator of N, and serves two channels having a 





common carrier. This fact alone does not materially change the effective- 


ness of regulation since the carrier is adjacent to the sideband which 




















W 
o 
a) | 
| [ | 
z j 
a? 
I< 
25 30 35 40 45 50 35 60 i 
NE LOSS IN OECIBELS 


Fig. 17—Typieal over-all channel net loss variation, nonrepeatered. 
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Fig Typical group receiving and repeater regulator characteristic. 


it controls in any case. There are other important differences, however 
between N and O channel regulators. In N the channel regulator follows 
the channel band filter and thus tends to compensate for its flat trans- 
mission variations. Also the N regulator is controlled from the demodu- 
lator de output and thus compensates in some degree for demodulator 
variations. In O, the twin-channel control is ahead of both the channel 
band filter and the channel demodulator, and therefore does not make 
up their variations. 

A statement might be interpolated at this point to emphasize that 
the relative advantages of single-sideband and double-sideband trans- 
mission are by no means easily listed and evaluated, since the differences 
are many and devious, some necessarily and some fortuitously. An ex- 


ample worthy of note is that in N it is necessary to be concerned about 


relative phase shift of the sidebands and in the instances of longer cir- 
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Fig. 19 Typical twin-channel regulator characteristic. 
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cuits, perhaps to equalize this phase shift in order to prevent serious 
reduction of signal output, or variation in channel net loss with fre 
quency. No such concern applies to 0. 

In regard to filter characteristics, it seems obvious that complete 
coverage is not feasible in this description. Instead typical curves only 
will be shown. 

Fig. 20 shows the general characteristics of filters for separating the 
wanted sideband from the carrier and unwanted sideband. The trans- 
mitting and receiving filters have similar shapes. The carrier pick-off 
filter characteristic is shown in the same figure. Fig. 21 shows the filter 
characteristics for separating the voice and signaling (3700 cycle) func- 
tions 

\nother filter case of interest is the line filter for separating, for ex- 
ample, the OA system from the OB system, and from the OC and OD 
systems, as well, if they are employed. Fig. 22 shows the configuration 
and loss characteristics of the GL (537A or 538A) filter. A Cy directional 
filter (530A) characteristic is shown on Figure 23. This filter assembly 
includes two filters to accommodate the OB high and low group assign- 
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Fig. 21—Typical receiving low pass and signaling filter characteristics 


ments. Similar characteristics apply to the Ay + By auxiliary filter 
(531A). The A and B characteristics are used in the group receiving 
filters Ap + Ds , (531B) and Bg + Dy , (531C). The D filter is a band- 
pass filter with relatively gradual cutoff to pass the 180-196 band for 
the channel filters, and has peaks at the group carrier frequencies of 
236 ke and 256 ke. These filter characteristics are not shown. 


PHYSICAL ARRANGEMENTS 


A four-channel carrier terminal is shown on Fig. 24. This terminal 
includes four channel units shown in detail on Figs. 25, 26, 27 and 28. 
In Fig. 28 the unit is separated into the three sub-assemblies, of which 
us noted above, the two voice frequency sub-assemblies are substantially 
the same as for N carrier. The carrier sub-assembly with its plug-in 
channel band filters is shown on Fig. 29 

The interior arrangement of the plug-in unit containing the trans 
mitting and receiving band filters is shown on Fig. 30. This assembly 
contains an adjustable ferrite inductance, a miniaturized transformer, 
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small size J 


and a erystal with the necessary fixed and adjustable capacitors. The 
is made possible partly by the high Q ferrite coil, and partly 
by the circuit configuration employing it 


\s compared with filters em- 
ploying air-core coils and having comparable cutoffs, the reduction in 
size of these filters is very striking 

The group receiving unit is shown with its plug-in filters on Fig. 31 


shown On | lz 3 


The filters are held in place by stud screws and nuts. The arrangement 
1 » ’ 


| is also used with different filters for the repeater ampli 
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fiers. The filter construction is shown on Fig. 32. This filter employs 
ferrite coils and condensers, having no crystals because of percentage 
band width considerations. These filters employ a form of printed wiring 
for interconnection of components. 

The terminal framework is shown on Fig. 33. This framework em 
ploys aluminum die-castings in contrast to the frabricated framework of 
N. This method permits the inclusion of a slide arrangement which 
guides the units into place, and insures proper registration of the plugs 
and jacks. Some units are above the framework; others are suspended 


from it. The same die-casting, inverted, serves both upper and lower 
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ind removing them, can covers have been eliminated. This 


and the somewhat wider distribution of units having a high con- 
centration of 


vacuum tubes, result in a relatively low temperature rise 
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nel unit, shown on Fig. 34. The same basic die-casting is employed, with 
minor rearrangement of the die, for the two twin channel units, the 
group transmitting unit, and the group oscillator. The part of the slide 


arrangement associated with a plug-in unit is shown at the top of the 


twin channel unit. 

All plug-in units are held in by a common cover (Fig. 24) which en- 
closes the handles of the units. For additional support a rapid action 
fasterner holds the tops of the channel and receiving group units. 

Repeaters may be either pole mounted or placed in a central office. 
\ group of two repeaters is shown on Fig. 35. This assembly employs a 
framework, shown on Fig. 36, which includes the same slide die-casting 
as the terminal. A central unit (also plug in) accommodates the two 


Group receiving or repeater unit. 





TYPE-O CARRIER SYSTEM 


Fig. 32—Typical directional or auxiliary band filter 


internal view 


_yerrrvsvree 





Fig. 33—Terminal framework. 
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Fig. 34-——Twin-channel unit. 


plug-in group oscillators, which are also shown in the photograph, to- 


gether with fuses, alarm lamps, ete. 

Pole mounted repeaters are housed in a cabinet, similar to that used 
for N. Such a cabinet, equipped with four repeaters is shown on Fig. 37. 

Since a maximum of four repeaters would have to be supplied by one 
pair of wires, it is not feasible to transmit power for the repeaters over 
line pairs. Instead the cabinet contains rectifiers and a line voltage 
regulator for obtaining 130 volts de from commercial ac supply. For 
reserve power supply, a cabinet is available containing a 24-volt storage 
battery and a dynamotor to supply 130 volts de to two repeaters (or 
two dynamotors to supply four repeaters) in case of power failure. 


ALARMS 


\t terminals a common alarm, operating from carrier failure, performs 
the functions of: First, dropping all connected subscribers to prevent 











Two repeater assembly 





tepeater framework with oscillators. 
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Fig. 37—Typical arrangement of pole mounted repeaters. 








TYPE-O CARRIER SYSTEM 


Fig. 38—Test stand. 


their being held during the interval of failure; and second, to make all 
circuits busy at both terminals, to prevent false seizure by operators or 
automatic switching equipment. Since many O systems may be em- 
ployed in situations where one terminal is unattended, facilities are 
included whereby, after failure, the system can be tested from either 
end, through the use of one of the signaling channels. If it is indicated 
that the system is operable it can be placed in service again without the 
necessity of a trip to the unattended terminal. 


SPECIAL SIGNALING FEATURE 


Arrangements are provided by which two O circuits can have their E 
and M signaling control leads interconnected without the use of the 


signaling converter, which is otherwise required. This feature is employed 


when two circuits are connected together on a permanent or semi-per- 
manent basis to form a single trunk. 


TESTING 


To facilitate testing at terminal points a test stand (Fig. 38) has been 
provided which supports an QO, or N, channel unit during test and 
adjustment. By a patch cord, the channel unit can be connected to its 
original framework if desired. Built in pin jacks permit bridging meas- 
urements to be made at selected points in the transmission circuit. 
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Efficient Coding 


By B. M. OLIVER 


Manuscript received May 14, 1952) 


This paper reviews briefly a few of the simpler aspects of communication 
theory, especially those parts which relate to the information rate of and 
channel capacity required for sampled, quantized messages. Two methods 
are then discussed, whereby such messages can be converted to a ‘‘reduced”’ 
form in which the successive samples are more nearly independent and for 
which the simple amplitude distribution is more peaked than in the original 
MESSAYE This reduced signal can then be encoded into binary digits with 
good efficiency using a Shannon-Fano code on a symbol-by-symbol (or 
pair-by-pair) basis. The usual inefficiency which results from ignoring 
the correlation between message segments is lessened because this correlation 


IS li SS 77 the reduced message, 


INTRODUCTION 


The term coding, as applied to electrical communication, has several 

meanings. It means the representation of letters as sequences of dots 
und dashes. It means the representation of signal sample amplitudes as 
groups of pulses having two or more possible amplitudes as in pulse 
ode modulation. Lately, it has also come to be the generic term for 
any process by which a message or message wave is converted into a 
signal suitable for a given channel. In this usage single-sideband modula- 
tion, frequeney modulation and pulse code modulation are examples of 
encoding procedures, while microphones, teletypewriters and television 
cameras are examples of encoding devices. 

This is a nice concept, but it is useful to distinguish bet ween two classes 
of encoding processes and devices: those which make no use of the 
statistical properties of the signal, and those which do. In the first class, 
the encoding operation consists simply of a one-to-one conversion of 
the message into a new physical variable, as a microphone converts sound 
pressure into a proportional voltage or current, or of the one-to-one 
remapping of the message into a new representation without regard to 


probabilities, as by ordinary amplitude, frequency or pulse code modula- 
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tion. In ordinary PCM for example, the message samples are converted 
into groups of on-or-off pulses. The particular combination of pulses 


in any group depends only upon the amplitude of the particular sample, 


not upon any other property of the message, and the same time is allotted 
to each group, regardless of the probability of that group or of the 
amplitude it represents. Almost all the processes and devices used in 
present day communication belong to this first class. In the second class, 
the probabilities of the message are taken into account so that short 
representations are used for likely messages or likely subsequences, longer 
representations for less likely ones. Morse code, for example, uses short 
code groups for the common letters, longer code groups for the rare ones. 

Processes of the first class we may call non-statistical coding processes, 
or simply modulation or remapping processes, The time of transmission 
is the same for all messages of the same length, and all messages are 
handled by the system with equal facility (or difficulty). These processes 
require no memory and have a small and constant delay. They are 
inefficient in their use of channel capacity. 

Processes of the second class we may call statistical encoding proc- 
esses. These processes in general require memory. The time of trans 
mission of messages of the same length may be different so that if 
messages are to be accepted and delivered by the system at constant 
rates, variable delays may be necessary at the sending and receiving 
ends. They are more efficient in their use of channel capacity. It is with 
this second type of process that this paper is concerned, although pro 
cesses of the first type may be used as component steps. Thus we con- 
sider systems of the type shown in Fig. 1, with the aecent on the word 
“efficient’”’. 


TRANSMISSION CIRCUITS AND THEIR VOCABULARIES 


Communication circuits or channels can, of course, differ in many 
respects. Either the peak signal power or the average signal power may 
be limited. The transmission may be uniform over the band or vary 
with frequency; it may be constant or subject to selective fading. The 
noise may be gaussian thermal or shot noise uniform across the band, o1 
peaked at some frequency; or it may be largely impulse noise or erratic 


MESSAGE 
= 


——— 


SIGNAL EFFICIENT DESCRIPTION OF MESSAGE 


Fig. 1 teversible statistical encoding. 
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static discharges. The best type of signal for one channel may be very 
poor Tol! another 

In the following sections it is assumed that the channel transmission 
characteristic is flat in amplitude and delay over a definite band and 
zero outside. It is also assumed that the channel has a definite peak signal 
power limitation, and that the noise is white gaussian noise. Such a 
channel is no mere academic ideal. It is in fact quite closely approached 
in practice by many circuits. Moreover, the conclusions based on these 
assumptions can usually be modified or extended to other actual cases, 
such as that of noise with non-uniform spectral distribution (as for 
example the coaxial cable). 

If the bandwidth of the channel is W, we can (using single sideband 
modulation, W necessary) transmit over it without distortion from fre- 
quency limitation signals containing frequencies from 0 to W (or —W 
to Win the Fourier sense). Such a wave can assume no more than 2W 
independent amplitudes per second. Any set of samples of the wave 
taken at regular intervals ; 
20 


The wave may be thought of as a series of (sin .)/a2 pulses centered on 


serves to specify the wave completely. 


the samples and of proportional height, and indeed the wave may be 
reconstructed from the samples in this fashion. This is the well-known 
sampling theorem. Thus a message source of bandwidth W can supply 
at most 21 independent symbols (samples) per second, and this same 
number can be transmitted as overlapping, but independently dis- 
tinguishable pulses by a cireuit of bandwidth W. 

Since, as will appear later, channels which are to transmit signals 
resulting from efficient statistical encoding must be relatively invulner- 
able to noise, we shall assume that the pulses on the channel are quan- 


tized. This allows regenerative repeatering to be used to eliminate the 


accumulation of noise. If there are b quantizing levels, and if the levels 


are sufficiently separated so that the probability of noise causing In- 
correct readings is negligibly small, then the capacity of the channel in 


bits sec 1s 
2W loge b. (1) 


Such a cireuit talks in an alphabet of b “letters”? and uses a language 
in Which all combinations of these letters are allowed. There are no for- 
bidden or impossible “‘words”. The circuit has a vocabulary of b one- 
letter words, b> two-letter words, b" n-letter words. The basic ineffi- 
cleney in present day electrical communication is that we build circuits 


with unrestricted vocabularies and then send signals over them which 
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use only a tiny fraction of this vocabulary. If all the letters of the written 
alphabet were used with equal probability and if all combinations of 
letters were allowed, then many words which are now long could be 
made shorter, and written text would be less than one third as long as 
English. Similarly, if we could arrange to let our circuits use their en 
tire vocabulary with equal probability, they could describe our messages 


with much less time (or bandwidth) on the average. 


EXCHANGE OF BANDWIDTH AND SIGNAL TO NOISE RATIO 


It was the advent of wide band FM, and other modulation methods 
which exchange bandwidth for signal-to-noise ratio, which revealed the 
inadequacy of earlier concepts of information transmission and ulti- 
mately led to the development of modern communication theory, or 
information theory’. 

One of the more familiar results of this theory is the expression for the 
maximum capacity of a channel disturbed by white noise: 


/ r 
C =W logo | + ) 
( N 


in which C is the capacity in bits ‘see, W ois the bandwidth and ?) N the 
ratio of average signal power to average noise power. This capacity can 
only be approached, never exceeded, and is only reached when the sig 
nal itself has the statistics of a white noise. The expression sets a limit 
for practical endeavor, and also gives the theoretical rate of exchange 
between Wo and P/N. 

A practical quantized channel, operated so that the loss of informa 
tion due to incorrectly received levels is negligible requires about 20 
db more peak signal power than the average signal power of the ideal 
channel to attain the same capacity. However, bandwidth and signal 
to-noise ratio are still exchanged on the same basis. For example, a satis- 
factory television picture could be sent over a channel with, say, 100 
levels. This would require a (peak) signal to rms noise ratio of some 40 4 
20 = 60 db. The bandwidth could be halved by a sort of reverse PCM: 


by using one pulse to represent two picture elements. But there are 10,000 


combinations of two samples each of which can have any of 100 values. 
Hence the new combination pulse would need 10,000 distinguishable 
levels and this would require a signal to noise ratio of 80 + 20 = (2 X 
10) + 20 100 db. 

It is evident that while bandwidth compression by non-statistical or 


straight signal remapping means is not an impossibility, it is neverthe 
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less impractical when the signal to noise ratios are already high What 
we should really try to do is make our descriptions of our messages more 
efficient so that less channel capacity is required in the first place. The 
can then be taken either in bandwidth or in signal-to-noise ratio, 


SabV itl 


whichever fits the requirements of our channels best. 


\essages can either be continuous waves like speech, music, or tele- 
vision; or they can Consist of a succession of discrete characters each with 
a finite set of possible values, such as English text. Because a finite band 
width ind a small added howe are both permissible, CONtTLAUOUS signals 
can be converted to discrete signals by the processes of sampling and 
quantizing . This permits us to talk about them as equivalent from the 
communication engineering viewpoint. Since many of the principles 
vhich follow are easier to think of with discrete messages and since 
quantization of the channel is assumed for reasons already stated, we 


shall think of our messages as alwavs being available in discrete form. 


Let S the symbol (or sample) rate of the message 


; the original bandwith of the continuous message 


number of quantizing levels 


Phen if all the message samples were independent and if all quantizing 


levels were equally likely, the information per sample would be 
I] log» f bits (3) 
the information rate would be 
Hy) = S log: (bits ‘see (4) 


and the message would use the full capacity of a channel with ( quan- 


tizing levels, and bandwidth S 2. Or by remapping / message samples 


} 1 lo 
With the f possible levels into( 


o ( 
— ) i; samples, a channel with b levels 


log 


; 
and bandwidth UW Dia ) could be loaded to full capacity, 
(oy }) 
llowever, it is not true that the successive samples ot typical messages 
are independent, nor is it true that the various sample amplitudes are 
in general equiprobable. Tf these things were true, speech and music 


would sound like white noise, pictures would look like the snowstorm 
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a TV set produces on an idle channel. Written text would look like 
WPEIPTNKUH WEIOZ—: a random sequence of letters. The statistics 
of the message, in particular the correlations between the various sam 
ples, greatly reduce the number of sequences of given length which are 
at all likely. As a result the information rate is less, and fewer bits per 
second are required to describe the average message 
A sequence of M binary digits can deseribe any ol ag possible mes 
sages. Conversely any of N messages can be deseribed by loge \ binary 
digits. The information rate, Ht. of a message source Ls therefore given by 
log 


; \ 
H lim bits/ symbol 


2) Ml 


where NV number of message sequences of length n. If the suecessive 


symbols of the message are independent but not equiprobable, then a long 
sequence will contain 2; symbols of tvpe 1, x. of type 2, etc. The number 
of possible combinations of these symbols will be 


fi 


I]t’ 


so that log NV = log n » 


log x;! 
a] . ho oe —F° 


For large enough n, all the x; will be large also and we may write, by 
Stirling’s approximation 


log N — log V2mrn + log n > log ~/2xru; 


Lj; lk yr 


But since Ye vj n, and since for large n, x Jjm where P\ Jj) is the 
probability of the j™ symbol, we have 


log NV — log V2arn + n log n n 2 log 
nM = P\D) log P\ J) 


log \ pay 

H, lim > pj) log p 
n~—>2 i } 

which is the expression Shannon derives more rigorously. //; is a maxi- 

mum when all the p(j) are equal to 1 ¢. Then 7/7, logs ¢ Hy. The 

more unequal the Dj), Le, the more peaked the probability distribution, 

the smaller HH, becomes. 
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If the successive samples are not independent, the message source will 
puss through a sequence of states which are determined by the past of 
the message*. In each state there will be a set of conditional probabilities 
describing the choice of the next svmbol. If the state is 7 and the condi- 


th 


tional probability in this state) of the next symbol being the j ‘is Di\)j), 


then the information produced by this selection is 


I] >. Py) log Dik9). (G) 


— 


} 


erage rate of the source is then found by averaging (6) over all 


vith the proper weighting; thus 


H= 2d pon dD POL pj) log pi). 


he greater the correlation between successive svmbols or samples of a 
message, the more peaked the distributions p,(j) become on the average, 
and this results ina lower value for //7. As Shannon points out, the in- 
formation rate of a source, as given by (7), Is simply the average un 
certainty as to the next symbol when all the past is known. But in a 
properly operating Communication channel the past of the message is 
available at both ends, so that it should be possible to signal over the 
channel at the rate H bits message symbol, rather than Hy as we now 
do. In present day communication systems we ignore the past and 
pretend each sample is a complete surprise. 

By completely efficient statistical coding it should be possible to re- 
duce the required channel capacity by the factor H) Hy). Whether or not 
this improvement can be actually reached in practice depends upon the 
amount of past required to uniquely specify the state of the message 
source. If long range statistical influences exist, then long segments of 
the past must be remembered. If there are m symbols in the past which 


determine the present state and each symbol has ¢ possible values, 


there will be @ states possible (although only 2”” of these are at all prob- 
I £ ; | 


able for large m). If m is large the number of possible states becomes fan- 


* ir ipl ilosophac il sense the state of a message source may be dependent on 
factors besides the past of the message. If the source is a human being, 

the state will depend on a large number of intangibles. If these could 

ken into account the resulting H for the message might be quite low 

universe is strictly deterministic one might say that H is ‘‘really’’ always 

When we deseribe the drawing of balls from the urn in terms of probabilities, 

we admit our ignorance as to the exact detail of the mixing operation which has 
occurred in the urn. Likewise the information rate of a source 1s a measure of our 
of the exact state of the source. From a communication engineering 

the knowledge of the state of the source is confined to that given by 


the messuge 
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tastically large and complete statistical encoding becomes an economic 
impossibility if not a technical one 


Let BY be a particular combination (the 7'") of k symbols in the past 


of the message. Each of these combinations at least partially determines 
the state of the svstem. Hence we can write an approximation to (7 


F, >» p B; > Pek ()) log Ps*\ J) 


Fy > Hy as | » olf only m symbols in the past influence the present 
state, then / need only be as great as m, in order that F’, H. In any 
case the sequence F, " F. , --+ Fy is monotone decreasing Naturally 
one should always pick the / svmbols in the past which exert the great 
est effect upon the present state, Le. which cause Pa Aj) to be as highly 
peaked as possible, on the average. In English these would be the im 
mediately previous letters; in television, the picture elements in the im- 
mediate space-time vicinity of the present element. 

Suppose we break the message up into blocks of length &. Each of these 
blocks mav be considered to be a character in a new (and huge alpha 
bet. If we ignore any influences from previous blocks, t.e. if we consider 
the blocks to be independent, then the information per block will be 
simply 

->) p' B*) log p(B). 
i 
Since there are / symbols per block, the information per symbol, Gis 


G;, : =. p(B;) log p( B;). (10) 
_—_ 
As | » ©, Cy > HT, since the amount of statistical influence ignored 
(between blocks) becomes negligible compared with that taken into 
account. 

If d is the number of binary digits required to specify a message i 
svmbols long, then as n — *, d nif — 1. For large n there are thus 
on messages Which are at all likely out of 2 1 possible sequences 
(in an ¢ letter alphabet). The probability that a purely random source 
will produce a message (i.e., a sequence with all the proper statistics) is 
therefore 


p j (11 
for large n. leven if // H is small, p — 0 rapidly for large n. This is 


why white noise never produces anything resembling «a picture on a 
television screen, for instance. For in television signals, //, — H > 1 
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very complicated picture mate rial, and n & 250,000 for a single 


no by (11), p, also represents the fraction of the possible signals 
nel of (levels which are likelv ever to be used by messages of 


vithout stutisticnl encoding 


LLY MATCHED CODES 


i sequence of binary digits can be remapped by a non-statistical 
process into a channel with 6 quantizing levels, or indeed into a wide 
variety of other signalling alphabets, it suffices to consider statistical 
coding processes and codes which reduce the message to a sequence of 
binary digits. An efficient code is then one for which the average number 
of binary digits, /7., per message symbol lies between Hy) and //. As the 
efficiency increases HI, —+ 1, so this ratio may be taken as an efficiency 

dex. With highly efficient processes, the sequences of binary digits 
produced will have little residual correlation, i.e., they will be nearly 
random sequences. Since the encoding process must be reversible the 
receiver must be able to recognize the beginnings and ends of code groups. 
Since we have at our disposal only zeros and ones, the divisions between 
code groups must either be marked by a special code group reserved for 
this purpose, o1 else the code must have the property that no short code 
group is duplicated as the beginning of a longer group. 

\ code which satisties this latter requirement and which is capable of 
unity efficiency is the so-called Shannon-Fano code, developed inde 
pendently by CoE. Shannon of Bell Telephone Laboratories and R. M. 
Fano of the Massachusetts Institute of Technology. This code is con- 


structed as follows: One writes down all the possible message sequences 


of length / in order of decreasing probability. This list is then divided 


Into two groups of as nearly equal probability as possible. One then 
writes zero as the first digit of the code for all messages in the top half, 
one as the first digit for all messages in the bottom half. Each of these 
groups is again divided into two subsets of nearly equal probability 
and a zero is written as the second digit if the message is in the top 
subsets, a one if it is in the bottom. The process is continued until 
there is only one message in each subset. Fig. 2a shows the code which 
results when this process is applied to a particularly simple probability 

We" Here each code group is a series of ones 
followed by a zero. The receiver knows a code group ts finished as soon 
isa zero appears. Although the longer groups contain mostly ones, their 


probability is less and on the average as many zeros are sent as ones. 
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(a) (b) 
Fig 2—Shannon-Fano codes for three different distributions. The successive 
bisections are indicated by the dashed lines and the number gives the step at 
Which that bisection took place 


If the successive message segments are independent, the code will gen- 
erate a random sequence of zeros and ones. Fig. 2b shows the code which 
results with another distribution. Here the termination of each code 
group is more complicated but the non-duplicative property exists so 
the receiver can still identify the groups. Fig. 2¢ shows the code which 
results when all the p( By) ure equal. It is the ordinary binary code. 

The length of each code group is equal to log 1 p(3%), for the cases 
shown in the figures. This is true in general so long as it is possible to 
divide the list into subgroups which are of exactly equal probability. 

When this is not possible, some code groups may be one digit longer 
as Shannon shows. The average number of digits per message symbol 
using this code is therefore given by 


-1/k > p(B) log p( Bi) ae | k i) [—1 + log p Bi)] 


G > Il 


For large k, H. —» G, — H and the efficiency approaches unity. With 
small hk, H, increases both because the smaller list of messages cannot be 
SO accurately divided repeated] Into equal probability subsets (so 
called ‘“oranularity”’ trouble), and also because more statistics are ig 
nored between the shorter blocks. 

The ordinary binary code provides a statistical match between mes 


suge source and channel only if the various message blocks B; have 
equal probability p(B; 1/2", and are mutually independent. With 
k = 1, p(B; p(j) and the “blocks” are merely the successive symbols 











~] 
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Ordinary PCM is statistically matched only to a random message source 
with flat distribution. 

If the messages from a source are characterized by frequent long runs 
of symbols of the same type (e.g., long runs of zeros) an obvious saving 
is possible by sending the value of the symbol only once, together with 
a code group Which gives the length of the run. This is commonly known 
as run length coding. The remaining sections of the message (between 
runs) mav then either be sent directly (.e., merely remapped by a non- 
statistical process) or they may be encoded by some other statistical 
process, if this seems warranted. In the latter case we have a mixed cod- 
nig procedure The codes representing run lengths must either be set 
apart from the remainder of the signal by ‘punctuating”’ codes, or iden- 
tifiable by some distinguishing characteristic. 

Run length coding may be generalized to take care of other common 
sequences besides runs of a single symbol. Any commonly occurring se- 
quence of symbols may be considered a ‘trun’ and treated in the same 
fashion. More complicated code groups will be required to specify the 
type of run, if a large variety is accommodated this way. Ultimately, 
the distinction between this type of coding and Shannon-Fano coding 
becomes rather nebulous, especially if a fixed maximum length of run 
is permitted, for then all possible messages of this length may be con- 
sidered “runs”? and simply encoded by the Shannon-Fano code. 

No optimal general solution of the coding problem is known. That 1s, 
one Cannot say in all cases exactly What coding procedure one should 


use With a given message source to produce the most efficient encoding 


for a given complexity of apparatus. Several procedures have been de- 
vised which seem suitable for certain types of messages and these are 


discussed in the following SeCTLONS 


N-GRAMMING 


Phe application of the Shannon-Fano code to a block of / symbols of 
a message in an (letter alphabet requires that ( different codes be used. 
The receiver must be able to recognize each of these and to regenerate 
the proper message block when Pa particular code Is received. If is On 
the order of 10 to 100 as is typically the case, we very quickly run out of 
room to house the receiver and money to build it with. On the other 
hand, if k is small, sav on the order of 1 to 3, considerable statistical 
information between bloeks is ignored. These considerations led to the 
development of a class of encoders known as n-grammers. The name 


stems from the fact that they operate on the n-gram statisties of the 
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message, to produce a reduced signal having more nearly independent 
symbols, but (in return) a highly peaked simple probability distribution 
Which allows savings with Shannon-Fano coding on a symbol-by-sym- 
bol (k = 1) basis. 


The simplest member of this class is the monogrammer. It is basically 


merely a re-ordering device. The operation may be best understood by 
the following example. Suppose someone supplied us with English text 
encoded into a quantized pulse signal as follows: 
Symbol Pulse height 
Space 
A 
B 
0 
D 


ewc. 


Now the letter frequencies in English are shown in Fig. 3. Merely to 
save average power in our channel we might wish to convert this signal 
into one in which the pulse height is not alphabetical, but in which the 
most common symbol is sent as a pulse of zero height, the next most com- 
mon as a pulse of unit height, etc. In other words, we would like the fol- 
lowing representation: 

Symbol Pulse height 
Space 0 
BE | 
, s. 
A ‘ 


ete, ete. 


The device shown in Fig. 4 will accomplish this translation. The orig- 
inal signal is applied to the vertical deflecting plates of a cathode ray 
tube. The rest position of the spot corresponds to ‘‘space”’, i.e. no pulse. 
A pulse one unit high deflects the spot to A, a pulse two units high de 
flects the spot to B, ete. 

Now in front of these spot positions we place a number of light at- 
tenuating filters. In front of the “‘space”’ position we place an opaque 
mask. Hence when the spot is deflected to “space” the photocell receives 
no light and no pulse is sent. In front of the “E” position we place a 
mask having one unit of transmission. So although / is received as a 


pulse 5 units high, it is sent as a pulse of unit height. In front of the 








~J 


30 rHE BELL SYSTEM TECHNICAL JOURNAL, JULY 1952 





‘T” position we place a mask with two units transmission, and so on. 
The signal amplitudes as received are thus re-ordered in the desired 
fashion 

Phe resulting signal has lower average power and this can sometimes 
be an advantage, particularly if several such signals are to be sent over 
a common channel by frequency division. In this case the extreme rarity 


of occurrence of high peak powers on all channels simultaneously means 
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Fig. 3--Letter frequencies in English. 
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that the system can be designed to have a lower peak power capacity 
The signal out of the monogrammer can be remapped into binary digits 
using a Shannon-Fano code, pulse by pulse. However, this could have 


been done equally well with the original signal merely by rearranging the 


code groups in the coder tube. It is when we extend the principle to di- 


grams and trigrams that the potentialities of the system become evident. 
We can easily take account of the influence of the preceding message 
symbol. To do this we apply the signal to the vertical plates as betore, 
and to the horizontal plates we apply the signal delayed by an amount 
equal to the time between successive pulses as shown in Fig. 5. Thus the 
beam is deflected vertically by the present message symbol, and horizon 
tally by the previous message symbol. Whereas before we used a single 
column of optical filters chosen in accordance with the simple probabil 
ities of the letters, we now have 27 columns, one for each letter and one 
for the space. The filters in each column are chosen in accordance with 
the conditional probabilities which apply when the corresponding letter 
was the previous symbol. For example, in the “Q” column (last letter 
Q), and the **l’” row (present letter (7) the mask would be opaque, since 
{is most common after Q. In general, the transmission of cell 77, in the 
i column and j row, is proportional to the rank of the entry for p 
when the entire distribution (conditioned on 7) is ordered in a monotone 
decreasing sequence. The amplitude distribution of the output pulses 
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from the digrammer will be more peaked toward zero amplitude than 
that of the monogrammer. This is illustrated by the signals in the figures. 
\t the receiver the same type of device, but with an inverse mask can be 
used to convert the signal back to its original form. 

The digrammer can, with a little assistance, supply all the data re- 
quired to prepare the encoding mask. If typical signals from the message 
source are applied to the cathode ray tube (without mask) for a long 
time, and a time exposure is made of the face of the tube, a lattice of 
spots will be obtained on the film. These spots will be dense where the 
high probability combinations occur and less dense elsewhere. The order 
of decreasing density in each column is noted, and the filter transmis- 
sions are arranged in the same order 

It is, of course, not necessary to use a phosphor, optical filters, and a 
photocell, An array of targets each of which connects to the appropriate 
tap on a load resistor might be simpler and more efficient. The cathode 
ray tube itself can be replaced with an appropriate diode switching net- 
work. Relay networks could be used for low -speed operation. 

\t the digrammer level we run out of new dimensions to use in the 
cathode ray tube. The principle can, however, be extended to trigram- 
ming and general n-gramming. For example, tetragramming could be 
accomplished by using a bank of ( digrammers all in parallel, and all 
deflected by the present and previous samples. Only one of these tubes 


would be turned on at a time however. Which one this was would depend 


on the other two previous symbols of the tetragram. These (by addi- 
tional delays) would be applied to the deflecting plates of a master switch- 
ing tube having an array of target plates in place of a mask. Depending 
on the particular combination of signal samples applied to this tube, 
the beam would strike a particular target. The target current would then 
be used to turn on the beam of a particular digrammer tube, namely the 
one with the proper mask for that particular combination of two past 
symbols 

The complete array of equipment is admittedly rather staggering, but 
then, rather eficient coding should result. In practice it would probably 
be found that the masks of many of the tubes would be so similar that 
little gain resulted from differentiating between them. That is, the state 
of the message source might be nearly equivalent for several past com- 
binations. In these cases, the group of tubes could be replaced with one 
having the best average mask, and the corresponding targets on the 
switching tube then tied together. This compromise would be particu- 


larly warranted for those tubes which were rarely used anyway. By these 
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tricks it should be possible to keep the growth of equipment down to 


something approaching 2"” rather than ¢" 


The output signal from the n-grammer will be, as we have seen, a series 
of pulses with an amplitude distribution very peaked toward zero and 
small pulses. If f ,the alphabet, is large, these pulses can be efficiently 
encoded into a Shannon-Fano code. For small alphabets, granularity 
trouble can be reduced by remapping the output pulses two-by-two 
into pulses of base (, and then encoding these into the Shannon-Fano 
code. 

The output signal from the n-grammer with English text as the input 
message is a pulse amplitude representation of the type of *‘ reduced 
text’? one gets by using running n-gram prediction on English, as de- 
scribed by Shannon’. 

More efficient encoding would result if the properly matched Shannon- 
Fano code for each particular conditional distribution were applied to the 
output pulses, rather than using the same code for all of them. The effi 
ciency of the coding operation would then be close to F’,, as given by (8 
(take k = n). This would add a great deal to the complexity and with 
most signals it is felt the gain would be small. If all the conditional dis- 
tributions were alike after ordering, the improvement would be nil. 

English text was used as the message in describing the n-gramming 
technique to emphasize the fact that it is a powerful general method 
which works even when the conditional probability distributions of a 
message are disorderly, multimodal affairs. It is obviously suited to other 
types of messages as well. Its main drawback is the complexity of ap 
paratus required, 


PREDICTIVE-SUBTRACTIVE CODING 


When the conditional probability distributions of a message are uni- 
modal (or merely strongly peaked as a rule in the vicinity of a particular 
sample amplitude) it is not necessary to re-order the distributions in 
order to obtain a reduced message for coding. The distributions may then 
merely be shifted along the amplitude scale until their modes are near 
zero (or their second moments about zero are nearly minimum). This 
shifting can be accomplished by computing from the preceding (n 1) 
gram the amplitude at which this mode or mean is located, and then sub 
tracting this computed amplitude (or the nearest quantizing level) from 
the actual amplitude of the present sample. The difference in each case 
is a symbol whose amplitude distribution is peaked in the vicinity of 
zero amplitude. Fig. 6 shows a block schematic of a system using pre 
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dictive-subtractive coding. In an actual system the reduced. signal 
encoded nto Shannon Fano code groups before 


vould ordinarily be 
transmission over the channel, 
If sy is the present sample amplitude, and s; , 8° 


sample amplitudes we compute a predicted value, s 


s, are previous 
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for the present 


sample which Is viven by 
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el. If the conditional probability distribution 


where ¢ » quantizing leve 


or the present sample is p,, then the difference, or output, or 
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Predictive-subtraective coding. 


hig 
(€ + Sp) 


wnal, e, Will have the conditional distribution ps, 
weighted 


( rror”’ 
The simple distribution is then the 


for this particular case 


ver all cases, Le 


pre >, p(s, 8, °: Sn) Ps, 


where the sum is over all combinations of 8; ; 
Predictive-subtractive coding has especial merit when a simple fune 


ay ape ¢ 


‘ s 


tion can be used for computing s, . This is often the case. When the 


function is simply a weighted sum of the past sample amplitudes, i.e 


W hie a 
0 


ve have what is Known as /inear prediction. Of course, linear prediction 
can always be used, but it may not be good enough with some types of 


Messages 
a, boe which minimize 


As Wiener has shown the coefficients 
lor simplicity, assume only two message sam 


ire readily computed 
from the past are to be used. We then have 
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where Ay , A., and slo are the values of the auto-covariance of the mes 


sage Wave at displacements of O, 1, and 2 sampling periods. Thus 
ab a).A, Dh A 


-_ ; fa | 
The autocorrelation (normalized auto-covariance) is given by @ - 


Ay is proportional to the average power in the message wave, so the 


° € ° . 
ratio p is the ratio of the power 1n the error signal to the power 


in the original message wave. Thus: 


a ab - a)py hd» 


from which 


With these values of a and b: 
1 — od; 
If d» ¢; , then the expressions simplify to 
h 0), p di . 
As can easily be shown, if @(2) e “” , then all the coefficients except 


a are zero, and a has the value e “. In other words, if the autocorrela 


tion function is of exponential shape, the previous sample alone is needed 
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for linear prediction. Samples before this add no further information as 
to the location of the mean of the conditional distributions.* 

It happens that in typical television signals the autocorrelation for 
small displacements shows a very nearly exponential behavior. Thus 
linear prediction on the basis of the previous picture element alone is 
a natural method for television, particularly in view of the simplicity of 
upparatus required, 

Linear prediction is easily instrumented. Fig. 7 shows in block sche- 
matic form the essentials of a linear predictor. Samples of the message 
are applied to a delay line. Taps along this line separated by the inter- 
symbol time of the message, or multiples thereof, make the desired 
past symbols available. The signals from these taps are merely attenu- 
ated by amounts corresponding to the coefficients a, b, ¢ «+> and added, 
\ differential summing amplifier is shown to allow for negative coeffi- 
cients, and also to accomplish the subtraction of the predicted sample 
amplituce from the present sample amplitude. 

\ complete linear predictor-subtractor is nothing but a transversal 


time domain) filter whose impulse response is 
fil ot aé(t — +r) — bé(t — 27) 
and whose equivalent frequency response is therefore 
I Ww l at he 


where 7 is the delay between taps. If, for example, simple previous value 
prediction is used (a Ll: 0: ¢ 


* From the preceding expression for p, we see that p = 0 (1.e., perfect predic 
2 possible) if 


20. l 
1 


the message samples alternate between two independent but constant 

r this case a 0, b l. If ¢ 2p 1 the autocorrelation is a cosine 

>the message consists of samples of a sinusoid. In this case a = 2¢,, 6 = 

¢, is nearly unity, the sinusoid is of low frequeney, and the prediction 

ipproaches “slope”? prediction (e extrapolation of a straight line through the 
lust two samples 


| vy case where perfect prediction is possible the wave is periodic and there 


fore 0 





EFFICIENT CODING 


It is often argued that linear prediction is therefore nothing more than 
pre-distortion (frequency-wise). If the message is unquantized and un- 
sampled, and if the signal from the predictor is applied to the channel 
as straight amplitude or single side-band modulation, the allegation is 
certainly true. Pre-distortion is a perfectly valid way of improving the 
statistical match between message, and channel, and destination as the 
optimum filter theory of Weiner and Lee shows. On the other hand, 
when the message is sampled and quantized, and when the output of 
the linear predictor is further encoded into a sequence of binary digits, 
and these are possibly remapped onto a higher base for the channel, then 
the information is being handled digitally throughout, and the usual 
reasons for a certain type of predistortion no longer apply. The best 
linear predictor will usually be quite different for the two cases. Even 
though analogue operations (such as subtraction of amplitudes) are used 
for convenience, the quantization makes the operation discrete and 
hence equivalent to a digital process. 

At the beginning of this section, we were a little vague as to whether 
the prediction should shift the modes or the means of the conditional 
distributions to zero amplitude. If the object of the prediction-subtrac- 
tion operation is to minimize the power in the error signal, then certainly 
the means should be shifted to zero. The coefficients as determined from 
the autocorrelation function do this aside from quantizing granularity. 
They specify an optimum least-square predictor, i.e., one which tends 


to minimize € = >i 7 pj). 
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Fig. 7—A linear predictor. 
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Power reduction is an index of merit when many reduced signals are 
to be sent by frequency division over one channel, as we have said, 
When the object is to reduce the channel capacity required for a single 


message source, then it is the upper bound entropy of the reduced signal 


which should be minimized, not the power. That is we want >i p()) 


log p(y) to be minimized. For certain types of signals this requires the 
modes to be shifted to zero, although this is by no means a general rule. 
Shifting the modes to zero may actually increase the entropy of the 
‘reduced” signal over that of the original message, by adding too many 
new symbol levels, as the example in the last section shows. 

It the original message has ¢ quantizing levels, the reduced message 


after predictive-subtractive coding will in general contain more than ¢ 
f 
levels since an error of more than 9 can be made in either direction. 


An n-gramming operation, on the other hand, never increases the al- 
phabet 


probability distribution (divide all coefficients by the sum over 
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Other operations besides simple subtraction of the predicted symbol 
from the present symbol are of course possible. However, in most cases 
it would seem that if a more complicated operation were indicated, 
n-gramming would have provided a better start. 


ILLUSTRATIVE EXAMPLE 


Let us compare the operation of n-gramming and prediction-subtrac- 
tion techniques on a hypothetical message. We will assume the message 
has digram statistics, but that longer range statistical influences either 
do not exist or are ignored. The statistics are then specified entirely by 
the joint probability distribution p(, 7) of a pair of symbols. Let us 
assume that there are ¢ quantizing levels, and that 


p(t, J) Ka 


where ais a constant > 1, and K is gviven by 


c- [Ee] 


‘7 


K is the factor which assures that > 7 P(t, 7 l. 

Thus the most likely level is that of the previous sample. A sample 
differing by one level is 1,a@ times as likely, one differing by m levels 
is a” times as likely. Figure 8 shows a plot of the relative values of 
p(t, 7) (neglecting the factor A). For ¢ 1, the total array would be 
the 4.x 4 portion enclosed by the dashed line. This sort of distribution 
is rather similar to those of typical television signals, as shown by pre- 
liminary measurements, although typical values of a have yet to be 
determined. With no statistical coding, the required channel capacity is 


HT, log. f bits sample. 


If the simple distribution of individual samples is taken into account, 
the required channel capacity is reduced to 


Hy, ==: - >> pli) log pli) 


where 


p(a) 2 pla, J) bs pir, J) p(y) 
i 


H, may be computed from the array of relative coefficients by adding 


the rows to form the sums 
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In terms of these sums, we have 


log -, —K 28 log S;. 
A i 
Since, with the assumed distribution, the S, are all nearly equal very 
little reduction in channel capacity is achieved by this step. 

With linear prediction, the modes of the distributions (¢ = 7) could 
be centered at zero merely by sending the difference between the present 
and previous sample (previous value prediction). This would give a 
reduced signal whose distribution mav be found by adding the array 


along the diagonals. The required channel capacity is then given by: 


k(“ — k) 


h 


a’ 


) 
log 


{—1 A ( f 
H, K flog Kf — 230 : 
k=] 


- | 
a 
Phe distribution of the signal from a digrammer is found by rearrang- 
ing each row of the table in order of decreasing probability and then 
adding the resulting columns. Call these sums S, . The digrammer out- 
put will thus require a channel capacity: 
t 
H * KS, log KS, 
d=] 


| t 
log K > S, log Sa 
\ 


d=] 


Lastly, the true rate of the source 1s given by 


Hi z pa) z=. pi(j) log psy) 


f l f I: 
log 7 - Hl, + 2K ‘2 k log a 


\ l ad 
Values for the above quantities were computed for a = z and n 
2, 3, 4, , 16,382, ©. For the case of a = 2, we find that 

K = [3¢- 401 — 2°97" 


and that as ¢ 
H,, Hyp, H > 4 + loge: 2.918 bits. 


The results are shown in the Table [and also are plotted in Fig. 9. 
While 7/7) and 7/7, inerease without limit as ¢ is increased, 1, , Hp, 
and ff quickly approach a definite limit. This limit exists because we 


assumed that the decrease in joint probability as a function of number 
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TaBLe [ 


Number of 


levels 


0 
1.252 GIS 


ade 


583 1.777 $37 
995 2.074 764 
575 2.381 2.157 
USS 2.552 2.370 
gy 2.768 2 678 
‘ € 2.850 2.818 
log «= 2 91S OILS 


(These figures were computed by slide rule so the fourth figure is 1 
significant 
of levels off the diagonal was the same regardless of f. In typical signals 
this is not true. The decrease is more apt to depend on amplitude diffe r 
ence and the finer the quantum step, the more levels a given difference 
represents. As a result, the probability will fall off less per level off the 
diagonal, and doubling ¢ will in general add one bit to // 


On the other hand, doubling the sampling rate will not in general 


double the required channel capacity, for the closer spaced samples will 


t 
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be more highly correlated. Thus in TV, doubling the horizontal resolu- 
tion would not double the bandwidth for the same picture material if 
use were made of the statistics. (Of course, increased resolution in TV 
might encourage the use of more detailed scenes and this would increase 
the required bandwidth 

It should also be noticed that for small ¢, linear prediction actually 
makes matters worse. The increase in the number of levels in the error 
signal more than offsets the peaking of the distribution. 

Since all the conditional distributions in this message are of similar 
shape (after ordering), 1p and Hare almost the same, for all ¢. The 
difference between /7, and [7p is slight except for small ( because the 
distribution we assumed is unimodal throughout. 

hig. 10 shows the simple probability distributions for (a) the original 
message, (b) the reduced signal from linear prediction, and (¢) the re- 


duced signal from the digrammet 


VARIABLE DELAY AND OTHER PROBLEMS 


We have seen in the last two sections how It is possible to convert 
au message for which H «< Hy asa result primarily of intersymbol correla 
tion, into a reduced signal for which H/ «< Ho as a result primarily of a 
highly peaked probability distribution in the individual symbols (i.e. 
one for which H, — IH). Since the operations are reversible, the true 
information rate, //, is preserved. In the original signal it was the 
conditional distributions which were peaked, while the simple distribu- 
tion Was relatively flat. In the reduced signal the simple distribution 1s 
peaked 

The result is that whereas a Shannon-Fano code would only have been 
effective on the original message if applied to blocks two or more symbols 
in length (and then it would ignore correlation between blocks), in the 
reduced signal the code will be effective on a symbol to symbol basis. 
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The encoding of the reduced signal into binary digits presents no 


theoretical difficulties. A PCM type coder tube* with the appropriate 


Shannon-Fano groups built into it is all that is needed. The biggest 
practical complication arises out of the fact that the code groups are of 
different length. Some messages, such as written text, can be fed into 
the system as fast as it can handle them. The transmission time will 
then vary with the message complexity. Others, such as television are 
generated and must be accepted and delivered at a constant rate. One 
solution is then to take the binary digits in big and little batches as they 
come from the coder and store the surplus in a sort of pulse “surge tank’”’ 
before they are sent over the channel at a regular rate. At the receiver, 
a similar sort of storage register is necessary as the pulses arrive over 
the channel at a regular rate and are used by the decoder at a varying 
rate. Devices which will perform this variable delay function satisfacto- 
rily for signals with relatively slow sampling frequency are available, 
and as the art progresses there is every reason to believe that high speed 
sampled signals like television can be handled also. 

It will be noticed that the digramming or prediction operation, while 
it involves memory, does not introduce appreciable transmission delay. 
Kach symbol of the reduced signal appears the moment the correspond- 
ing message sample is applied. The total transmission delay required 
for statistical coding thus depends upon how much variation is required 
in the variable delay units. This in turn depends upon the degree of 
stationarity in the “local information rate’’ of the message. For example, 
in television, if each line could be described (by the n-grammer and 
subsequent coder) in the same total number of binary digits, then the 
total delay variation and total delay would be less than one line time 
Since this is not true, we either must have enough channel capacity to 
send in one line time the number of digits corresponding to the “worst” 
line, or enough variable delay to average the existing rate over many 
lines. 

Probably the most practical solution is to provide sufficient channel 
capacity and variable delay to take care of all but a small fraction of 
the possible message sequences. Then when an unusual stretch of message 
continues long enough for the variable delay to be nearly all used up, the 
system should fail in some relatively harmless way. In television, the 
sampling rate could be momentarily reduced, for example. This would 
degrade the resolution in rare situations, but a small amount of this 
could be tolerated in return for transmission savings. 

If long blocks of the message are efficiently encoded as a group, then 


an error in transmission may cause the whole block to be reproduced 











7900 fHE BELL SYSTEM TECHNICAL JOURNAL, JULY 1952 


incorrectly. If n-gramming or prediction is used, then an error in trans- 
mission will cause the receiver to function improperly not only for that 
symbol, but its further n-gram decoding or prediction will also be dis- 
turbed. Thus errors of transmission are either spread over definite blocks, 
or propagate Tor a considerable time rather than being confined to the 
particular symbols sent in error. In fact, if the encoding were completely 
efficient, all received sequences would be possible messages, and a single 


error could convert the received message from the proper one into a 


completely different but possible one. With no redundancy there is 


no way to recognize an error. [t is for these reasons that we have assumed 
a rugged (quantized) channel. In view of the eight to ten db more average 
power required in a quantized channel to achieve the same channel 
capacity as an ideal channel of the same bandwidth, considerable statis- 
tical saving must be possible before statistical coding may be warranted. 
This initial handicap of course does not apply to channels already de- 
signed to work on a digital basis for other reasons. Lastly, the use of 
error correcting codes’ is a possibility. In these codes a small amount of 
redundancy is introduced in a particularly efficient fashion. As a result, 
a certain frequency of transmission errors can be tolerated without 


causing errors in the reproduced message. 
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Statistics of Television Signals 


By Ek. R. KRETZMER 


Nl iunuseript received February 28, 1952 


Veasurements have been made of some basic statistical quantities characteri- 
zing picture signals. These include various amplitude distributions, auto- 
correlation, and correlation among successive frames. The methods of meas 
urement are described, and the results are used to estimate the amount by 
which the channel capacity required for television transmission may be re 


duced through exploitation of the statistics measured. 


INTRODUCTION 


One of the teachings of information theory is that most communica 
tion signals convey information at a rate well below the capacity of the 
channels provided for them. The excess capacity is required to accom- 
modate the redundancy, or repeated information, which the signals 
contain in addition to the actual information. Removal of some of this 
redundancy would reduce the channel capacity required for transmission, 
thus opening the way for possible bandwidth reduction. In order to 
remove redundancy, one must first understand it; the amount and nature 
of the redundancy can be completely defined in terms of various statis 
tical parameters characterizing the signal. 

It has been pointed out that the existence of redundancy is particularly 
evident in the case of television; moreover, its elimination is highly de 
sirable because of the large bandwith presently required for transmis 
sion. Evidence of redundancy is found in the subject matter of televi- 
sion —the average scene or picture. Knowing part of a picture, one can 
generally draw certain inferences about the remainder; or, knowing a 
sequence of frames, one can, on the average, make a good guess or pre 
diction about the next frame. In either case, knowledge of the past re 
moves uncertainty as to the future, leaving less actual information to be 
transmitted. 

Another way of looking at this is to visualize the picture as an array 
of approximately 210,000 dots, 500 vertically, 420 horizontally, cor 
responding, respectively, to the 500 scanning lines and 420 resolvable 
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picture elements per line of the standard television raster. Each dot can 
have, say, lOO distinguishable brightness values in a good-quality pic 
ture. Phe number of possible combinations is therefore approximately 
LOO or 10 


\t the usual rate of 30 frames per second it) would 
take approximately 10°°"" years to transmit all these “pictures,” which 
our present television system is fully prepared to transmit! The vast 
majority of these “pictures” will, of course, never be transmitted in this 
age because the average picture statistics virtually preclude the pos- 
siblity of their occurrence 

If all of the redundancy alluded to in the preceding paragraph were 
to be « xpressed in terms of statistics, the array of data would be stagger- 
ing.* Redundancy encompassing even a small part of a single frame 
implies statisties of enormously high order because of the large number 
of possible past histories. The initial attention should therefore be 
focused on local redundancy, ChHcompassing only a few adjoining pic- 
ture elements. Accordingly, measurements have been made of the fol- 
lowing statistical quantities. 

1. Semple probability distribution of signal amplitudes corresponding 
fo picture brightness. This encompasses only a single picture element, 
revealing the relative probabilities of this or any element’s assuming 
the various possible brightness values, in the absence of any past-his- 
tory information. 

Simple probability distribution of error amplitudes resulting from 
linear prediction of television signals. Only the simplest type of linear 
prediction is considered here, so-called previous-value prediction, which 
pred ts each picture element to have the same brightness value as the 
preceding one. The prediction error signal is simply the difference be- 
tween the picture signal and a replica delayed by one Nyquist interval 
one-half the reciprocal bandwidth or the time interval corresponding 
to the spacing between picture elements). The distribution of this error 
signal encompasses two picture elements (past history of one element) 


and therefore is a condensed version of the family of first-order joint 


probability distributions. 


3. Autocorrelation of typical pictures. This statistical quantity is an 
even more streamlined version of various families of different-order 
jomt probability distributions. Each family corresponds to just a single 
point on the autocorrelation curve; the ordinates of the curve represent 


the average correlation between picture elements spaced by various 


tatistics extending, say, over one frame period, would comprise 
mal probability distribution per pieture element for each possible 
With the approximate figures cited above, the number of distribution 
f which would be similar) is 210,000 & 109.999 or 10429,004 








STATISTICS OF TELEVISION SIGNALS 


distances This correlation, Say, bet ween horizontally adjoining elements 


is simply the average product of the two brightness values of each pair 


of neighbors, relative to the average square of all brightness values 
The three quantities enumerated above contain a great deal of sta 

tistics in very compact form, but these statistics are essentially of a local 

and linear nature. They do not include the bulk of the large-scale re 


dundancy, which is of a far-flung and nonlinear nature 


POCORRELATION 


Al 
For a function of time, f(t ), the autocorrelation ean be expressed “as 
1) 


Fig. 1 Picture autoecorrelator 
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averaged over all time, for various values of the time shift 7. In the case 
of a picture transparency, the optical transmission is a function of two- 
dimensional space, expressible in polar coordinates as T(s/¢%), and the 
autocorrelation can be expressed in analogous fashion. The time variable 
(is replaced by the space coordinate s/%, and the correlation time shift 7 


is replaced by a space shift As @, so that the new expression is 
g(As/%) = T(s/?) T(s/ + As/®), (2) 


averaged over as much area as practicable. This space-domain auto- 
correlation is much easier to measure than the time-domain autocorrela- 
tion. We need merely measure the relative optical transmission of two 
identical cascaded transparencies, shifted from register by a variable 
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Fig. 3—Close-up view of slide holding assembly and shifting mechanism of 
picture autocorrelator. 


amount. The averaging process is inherent in such a measurement. 
The apparatus used to measure autocorrelation is shown in Figs. 1 


and 2. The chamber at the bottom contains a light source of very 


constant intensity and a convex lens to collimate the light. The middle 
part, made of accurately machined aluminum, holds the two identical 
slides of the picture under test, and an aperture exposing a large circulai 
area of the slides. The top chamber contains a collector lens and a photo 
multiplier tube which (on a microammeter not shown) gives a sensitive 
indication of the total light transmitted through the slides. Fig. 3 
shows a close-up view of the slide-holding assembly. Two close-fitting 
graduated aluminum rings permit accurately determined rotation of 
both slides or one slide, and the micrometer drive permits translational 
displacements measurable to within one mil (moving the two slides by 
equal and opposite amounts); the separation between picture elements 
is approximately 7.5 mils horizontally and 5 mils vertically (for the 
24” by 34” slide size used). 

The light transmission is always a maximum when the two slides are 
in precise register (As = 0). For large shifts the transmission fluctuates 
about a nonzero asymptote. The nonzero asymptote results from the 
fact that the average transmission is always positive, and the fluctuation 
from the fact that large displacements introduce substantial amounts of 
new picture material into the aperture. Since these components tend to 
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obscure the correlation effects, it is useful to make additional measure- 


ments which enable us to subtract them out completely. This leaves us 


with a ‘pure’ autocorrelation A(As/?), which is then normalized so as 


to have a peak value of unity. It is given by 


Ts T°(0) 


where 7 ( — @ ) is the transmission through the two easeaded slides 


shifted by equal and opposite amounts —— at an angle @ with the hori- 


sip ee : : 
zontal, and rs ( = 4 ) is the transmission of a single slide with displace 


As 
ment —- at the sume angle 6. 
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Fig. 5—Plots of autocorrelation in horizontal and vertical directions for two 
pictures. 


Fig. 4 shows some pictures for which autocorrelation measurements 
have been made. The results can be presented in the various ways 
shown in Figs. 5, 6, and 7. Fig. 5 shows conventional plots of A versus 
As in the horizontal and vertical directions. Scene B is seen to have more 
correlation than Scene D, and curve shapes range from remarkably 
linear to somewhat like exponential. Fig. 6, giving contours of constant 
autocorrelation, brings out the variation with the angle 6. Scene A 
happens to have its greatest correlation in the vertical direction, but 
that was not found to be a general rule by any means; Scene B, for ex 
ample, has its greatest correlation in the horizontal direction. No pre 
ferred directions appear to exist in general. In Fig. 7 attention is focused 
on the more local correlation, for small values of As. The average cor- 
relation among horizontally adjoining picture elements, designated by 
Ay, is seen to be approximately 0.99 for Scene B and only 0.75 for 
Scene C. As denotes the correlation for a horizontal spacing of two 
picture elements while Ao; denotes the correlation among vertically 
adjoining picture elements. 

It should be pointed out that the pictures which gave the above 
results were not band-limited to the standard 4-me resolution. However, 
before the results were used quantitatively, the proper band limitation 
was applied mathematically. This has the effect of rounding off the peaks 
of the curves, decreasing the autocorrelation drop within the first Ny- 
quist interval by up to approximately 24 per cent. 
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PROBABILITY DISTRIBUTIONS 


A probability distribution of amplitudes is generally shown as a plot 
of probability density versus signal amplitude. Probability density, say, 
corresponding to amplitude 2,, is the probability of finding the signal 
amplitude between x; and x; + dx, divided by the differential amplitude 
increment dx. Conversely, the probability of finding the signal ampli- 
tude between x; and x; + dz is given by p(x,)dz, p(x) being the proba- 
bility density corresponding to amplitude 2. 

If a cathode-ray spot is deflected, say horizontally, by the signal in 
question, its average dwell time at any point is directly proportional to 
the corresponding probability density. In the optical system shown in 
Fig. 8, a cylindrical lens maps each point into a vertical line which is 
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Fig. 8—Basic arrangement of probabiloscope. 














h 


then tapered in intensity by an optical density wedge before reaching a 
high-contrast photographie film. Depending on the dwell time at any 
amplitude level, the corresponding tapered line has enough average 
intensity to blacken the film up to a certain level. This level is pro- 
portional to log p(x), since the density wedge is tapered exponentially 
so that the intensity of each tapered line of light reaching the film 
diminishes, say, by a factor of ten for each inch we travel up the line. 
The film in effect traces out a contour of constant exposure. 

Two or three iterated photographic printings increase the effective 
gamma sufficiently to yield a contour of ample sharpness. This contour 
is then changed to a sharp line by a simple dark room trick: while the 
film is in the development tray, already fully developed, it is momentarily 
exposed to light. The blackened portion of the film is unaffected, the 
clear portion is fully blackened, while the transition contour, being 
partly opaque, is not fully blackened. By printing from this film we then 
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obtain a well-defined black-on-white curve of p(r) versus 2 on a loga 
rithmic probability scale. The logarithmic scale has the advantage of 
making the curve shape independent of exposure length and giving uni- 
form relative accuracy over the entire range. 

hig. 9 shows some typical results obtained by means of the “‘proba- 
biloscope.”’ ‘Phe two small curves are distributions of two different still 
pictures. The left-hand end corresponds to black, the right-hand end to 
peak white; the blanking intervals (slightly blacker than black) cause 
the peaks at the extreme left. (The signals did not contain any synchro- 
nizing pulses The tall and slender curve at the right of Fig. 9 is the 
distribution of errors resulting from = previous-value prediction of one 
of the pictures in Fig. 4. The peak corresponds to zero error which is 
seen to be most probable, as it should be if the prediction criterion is 
good. Increasingly larger errors are increasingly improbable or rare. 
Phe six decades of probability density spanned by the curve were ob- 


tamed in three separate exposures and subsequently joined, since stray 
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light limits the useful range of the probabiloscope to approximately two 
decades. In obtaining those sections of the curve corresponding to the 
few and far-between large errors, a long exposure was used and the 
cathode-ray beam was blanked whenever passing through the range of 
zero or small errors. The vertical seale on all curves is determined solely 
by the density taper of the optical density wedge. If this scale is to repre- 
sent true probability density, instead of a proportional quantity, if 
should be shifted up or down so as to make the area under the curve 
equal to unity 


APPLICATION OF RESULTS 


The statistics measured can be put to various uses, such as in the 
design of better predicting or coding schemes. The most interesting 
application is probably in estimating the reduction in channel capacity 
which the measured statistics show to be theoretically possible. In 
other words, the results can give us various lower bounds to the re 
dundancy of television signals. 

For the sake of illustration, suppose that the signal is quantized into 
64 amplitude levels. An ordinary television channel assumes all 64 
levels to be equally likely, hence is prepared to accommodate log, (4 
or 6 bits per sample. But the simple amplitude distribution of the 
signal is not flat, so that all 64 levels are not equally likely. The maximum 


possible associated average information content per sample is given by 


Huu = 2, pi log p 


where p, is the simple probability of the signal’s falling into the 7th 
level. Since the 64 p,’s are unequal, H,,,. 1s necessarily less than 6 bits 


For all available data the average value of H/,,.. turns out to be ap 


proximately 5 bits, indicating a one-bit redundancy. The latter figure 
is essentially independent of quantization. 

The prediction error signal still contains all the useful picture in 
formation. The maximum possible information content per sample (max- 
imum in that all samples are assumed to be completely independent 
is still given by (4) but in this case the 64 values of p; are obtained 
from the peaked error distribution. The average* result from all available 
data turns out to be approximately 3.4 bits below the 6-bit ceiling, show 

* This average was computed by averaging the various redundancy values ob 
tained for the individual pictures, rather than averaging all statistical data and 
then finding one corresponding average redundaney. The average computed here 


is more favorable and ean be realized only if optimum coding is performed on a 
short-term basis rather than on the basis of one set of long-term statistics 
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ing that the original signal must have contained at least 3.4 bits of 
redundancy. 

The autocorrelation can also furnish a lower bound to the redundancy, 
as has been pointed out by P. Elias in his Letter to the Editor of the 
Proceedings of the I.R.E. for July, 1951. If, for example, the correlation 
(yw, between horizontally adjoining picture elements, is high, the cor- 
responding lower-bound redundancy is very roughly equal to 


R loge (1 -- Ajo) bits sample. (5) 


\lternatively, taking the Fourier transform of the autocorrelation yields 
the power spectrum P(f), from which we can find the lower-bound re- 
dundaney through the relation 


- | loge P(f) df + 4 loge W + logs K bits/sample, (6) 
~ “0 


1 aoe 
where W bandwidth in eps, and —, = [ P(f) df. 
K “0 


Using either method, one obtains approximately 2.4 bits for the 
average* of the available data. This is an approximate bound, in that 
it apples strictly only to functions having gaussian amplitude distri- 
butions, 

Suppose, then, that we have exposed an average redundancy of at 
least 3 bits per sample. This means a potential 3-bit reduction in the 
channel capacity required for television transmission. In a 6-bit system 
(64 amplitude levels) this means a 50 per cent reduction, and hence a 
potential halving of the bandwidth with the aid of an ideal coding scheme. 
It is true that the decorrelated signal is somewhat ‘‘frail,’’ i.e., vulner- 
able to interference, so that it might be desirable to use a ‘‘rugged”’ 
system of the PCM variety for transmission. Thus, if a Shannon-Fano 
code were used, the 3-bit decorrelation should enable us to send tele- 
vision by an average of 3 on-off pulses per picture sample rather than 
6. This represents a two-to-one saving over the usual PCM bandwidth. 
More spectacular reductions are likely to be achievable only by tap- 
ping the large-scale redundancies mentioned earlier. 


FRAME-TO-FRAME CORRELATION 


There is, of course, a great deal of interest in the possibility of utilizing 
the similarity between successive frames. Accordingly, adjacent-frame 


* See previous footnote. 
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correlation was measured for two typical motion-picture films, by means 
of the apparatus described in the section on autocorrelation.* The results 
were 0.80 and 0.86, after correction for the 4-me bandwidth limitation. 


This means that ‘‘previous-frame”’ prediction can remove only slightly 


more than one bit of redundancy per sample. More complicated schemes 
would presumably be more successful in taking advantage of the large 
frame-to-frame redundancy which undoubtedly exists. 
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* The expression used in evaluating the correlation between frame 1 and frame 
2 (any two frames) is 
Ts 1? 
Cz mm ; 9? 

Ti i; 
where 7’: is the optical transmission of frames 1 and 2 in cascade, 7’; is the average 
of the individual transmission of frames 1 and 2, and 7';, is the average of the 
transmissions of two cascaded slides of frame 1 and two caseaded slides of frame 
2, respectively. In all cascade transmission measurements, the two frames must 
be in precise register. 
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The correlation present in a signal makes possible the prediction of the 
future of the signal in terms of the past and present, If the method used for 
prediction makes full use of the entire pertinent past, then the error signal 
the difference between the actual and the predicted signal—will be a com- 
pletely random wave of lower power than the original signal but containing 
all the information of the original. 

One method of prediction, which does not make full use of the past, but 
which is nevertheless remarkably effective with certain signals and also 
appealing because of tts relative simplicity, is linear prediction. Here the 
prediction for the next signal sample is simply the sum of previous signal 
samples cach multiplied by an appropriate weighting factor. The best values 
for the weighting coefficients depend upon the statistics of the signal, but 
once they have been determined the prediction may be done with relatively 
simple apparatus 

This papel describes the apparatus used for some C4 pe roments on linear 


wrediction. of television signals, and deseribes the results obtained to date. 
/ / 


INTRODUCTION 


Linear prediction is perhaps the most expedient elementary means of 
removing first order correlation ina television message. Before discussing 
the advantages and disadvantages of linear prediction, it might be well 
to consider what is generally meant by correlation in a television pic- 
ture and why it should be removed 

\lmost every picture that has recognizable features contains both 
linear and non-linear correlation. Each type of correlation helps in 
identifying one picture from another; however, linear prediction is only 
effective in removing linear correlation, and for this reason, future ref- 
erences to correlation will refer only to its linear properties. With tele- 


Vision, a signal is obtained as the result of scanning; hence, the cor- 


iO4 
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relation is evident in both space and time. Briefly, correlation is that 
relation which the “next” elemental part of the signal has with its past 

To leave correlation in a message is to be redundant, and this effec 
tively loads the transmission medium with a lot of excess “words”’ not 
necessary to the description of the picture at the receiving end. It is 
then more “efficient” to send only the information necessary to identify 


the picture, and to restore the redundancy at the receiver 


EFFICIENT TRANSMISSION 


The more efficient we are in sending pictures over a given transmission 
line, the more alarmed we become at the increasing amount of equipment 
that is required at the transmitting and receiving terminals. Certainly 
the design will be a compromise bet ween the complexity of apparatus and 
the efficiency achieved. The ingenuity of engineers will be taxed along 
these lines for vears to come; however basically, the general form of 
these systems will be similar to that shown in Fig. 1. Although not 
always separable, four essential operations are required-namely, decor 
relating, encoding, decoding and correlating. The transmitting decor 
relator and the encoder encompass the principal design problems, since 
the decoder and correlator at the receiving end perform the reverse 
operations which interpret the code and add in the redundancy that was 
removed, 

Decorrelation involves prediction, and as the predictors are more 
nearly made to predict the future of the signal, the more the output 


signal from the decorrelator resembles random noise. The essential! 


picture information is still present, which means that our original picture 


signal can be obtained at the receiving end without theoretical degrada 
tion. The basie job of the encoder is to match the picture information 
out of the decorrelator to the channel over which it is to be transmitted. 
There are several encoding operations. The first concerns the rate of 
information into the encoder, and that required out of it. In the case 
of television, there are flat, highly correlated areas as well as areas 


containing more concentrated detail. This means that the information 
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Fig. 1—Block diagram of an efficient transmission svstem employing reversible 
decorrelating and encoding means 
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rate varies When the picture is scanned at the conventional uniform scan- 
ning rate. The output of the encoder feeds a transmission line that has 
a definite channel capacity, and if maximum efficiency is to be obtained 
from this transmission medium, then the rate of information into it 
must be held relatively uniform at a value near the channel capacity. 
It is the job of the encoder to take the varying rate of information from 
the decorrelator and feed it to the channel at a constant rate. At the 
receiving end, the decoder must take the constant rate of information 
and deliver it to the correlator at the variable rate as originally fed into 
the transmitter’s encoder. Thus, to perform this task, a variable or 
elastic delay to run ahead or behind, depending on the information con- 
tent of the picture being scanned, is an important part of the encoder. 
Over a long period of time, the variable delay would average out to 
some fixed value. This variable delay must never run out, even when the 
detail is concentrated. There are instances when this condition could 
not be met, such as an extended reproduction of a snow storm; however, 
with good design the system should fail ‘‘safe’’—a slight degradation of 
picture quality. This condition can be made infrequent enough to cause 
little concern. 

The encoder design must also account for noise as well as bandwidth 
of the channel and must consider the ultimate effect of an error that 
may be introduced by noise along the transmission line. As more re- 
dundaney is removed to get at the “essence” of the picture signal, the 
more important it is to guard this “‘essence,”’ as mistakes presented to 
the receiver will propagate themselves longer in the absence of correla- 
tion. Errors can be minimized by rugged systems of modulation such 
as PCM, where the signal-to-noise ratio of the transmission line deter- 
mines the base of the PCM system selected. In any event, the encoder 


must send the information so that the effect of errors will not appreciably 


disturb the pieture, 


DECORRELATION AND LINEAR PREDICTION 


Fig. 2 illustrates, in a general way, a means of decorrelating the sig- 
nal, S)(t). For purposes of explanation, the encoder and decoder have 
been omitted, and the transmission between the receiving and sending 
terminals, idealized. The predictors, P?, are identical, and base their 
prediction, S,(¢), on the signal’s past history. In this way, the output 
of the computer represents the discrepancy between the actual value of 
the signal sample and the predictor’s prediction. By this means we are 
sending only our mistakes—the amount by which the next picture ele- 
ment surprises us. For example, if the computer is so designed that it 
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Fig. 2—Decorrelator and correlator showing reversible nature of this method 
of removing redundancy. 


bases its prediction on the ‘previous frame,’ and we are transmitting 
a “still,” there will be no surprises after the first frame and consequently 
no output signal. Certainly it is redundant to send the same picture 
more than once. 

Linear prediction provides an easily instrumented means of removing 
redundancy. With linear prediction the next signal sample is simply 
the sum of the previous signal samples, each multiplied by an appropriate 
weighting factor. The best values for these weighting coefficients de- 
pend on the statistics of the signal. 

Fig. 3 is a block diagram of a decorrelator employing linear predic- 
tion. The delayed versions of the input signal can be obtained from 
taps along the delay line. The weighting coefficients for each of the 
delayed signals are selected by loss in their respective paths as shown 
by the amplitude controls. The polarity of each signal can be determined 
by the switches. The output is simply the sum of these weighted — 

If we consider the signal on a continuous basis (not quantized « 
sampled), linear predictors can be characterized as ordinary >t 
filters used to predistort the frequency spectrum of the signal. As such, 
they can be designed in the frequency or time domain. However as will 
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Fig. 3—General block diagram of decorrelator employing linear prediction 
Linear prediction bases its prediction on the weighted sum of previous signal 
samples. 
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be shown, it is much easier to recognize circuit: configurations that 
reduce redundancy in the time domain. To this end, and for purposes 
of encoding, the signal is thought of as signal samples uniformly spaced 
at Nyquist intervals. Thus, amplitude values obtained by sampling 
a 4.0 me picture signal at § microsecond intervals serve to specify the 
signal completely. Fig. 4 shows a small portion of a television raster where 
the signal is represented by signal values spaced at Nyquist intervals, 
r. The coordinates shown are designated with respect to the “present 
value” of the signal, Soo . The positive coordinate directions are shown 
by the arrows. The past is represented by positive coordinates —the future 
by negative coordinates. In this way, the previous value of the signal 
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Sx,y ~ 2W 
Fig. 4A small portion of a television raster showing geometrical location of 
signal samples with relation to the “present value’’ of the signal, S, 
taken one Nuquist interval before So » is designated by S; 9 — the previous 


line samples by So.1, ete. 


METHODS OF LINEAR PREDICTION 


\s previously stated, with linear prediction the next signal sample, 


t), is simply the sum of the previous signal samples each multiplied 


by an appropriate weighting factor. Thus, 
Sy(l Ayo, 


represents the weighted sum of all the previous signal values. The error 
signal, ¢, as shown in Fig. 2, is represented by the difference between the 


present vaue of the signal, Spo and the predictor’s prediction. 
So.0 S,(t) 


There are several specific types of linear prediction that deserve fur- 
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ther explanation—namely, ‘‘previous value,” “slope,” “previous line,” 
“planar” and “circular.” 

Previous value” prediction is illustrated in Fig. 5. Here the prediction 
is taken to be the signal amplitude of the preceding picture element. 
The previous amplitude of the signal, S; o is subtracted from the present 
value of the signal, So». The error signal is given as 


€ S ) Ss 1 


The filter characteristic can be expressed as 


Fiw) = (2 sin =) € \2 


This method of prediction proves to be rather effective in reducing the 
average power for most television pictures. The expression for the filter 
characteristic given above shows that the peak amplitude can be twice 
that of the original signal. 

“Slope” prediction is illustrated by Fig. 6. “Slope” prediction is so 
called because it is equivalent to passing a straight line through the 
two previous signal values, with the assumption that this line will pass 
through the next signal value. The predicted signal is given by 

Sp = Zo — No 
The frequency and phase characteristic is expressed as 


F(w) [4 sin? wre 


For this method of prediction, the peak amplitude of the error signal 
can be as much as four times the peak amplitude of the original signal. 
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Fig. 5—Example of ‘‘previous value’’ prediction, where the error signal is the 
difference between the actual value of the signal and the previous value 
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It is of interest to mention that ‘slope’ prediction is equivalent to 
two “previous value” predictors in tandem. Three or more ‘“‘previous 
value” predictors in tandem are equivalent to a binomial weighting 
of the previous values of the signal to form a predicted signal. 

For example, the prediction for three “‘previous value”’ predictors in 
tandem is given by 
Sp = 351.0 aie 382.0 T S30 
For four “previous value” predictors in tandem 


Sp = 48,5 — 6Se.6 + 4835 — S40 


As can be seen from the above equations, further extension of “previous 
value” tandem operation results in a heavier weighting of picture ele- 
ments further and further from the point to be predicted. For most 
pictures this leads to greater errors. 


“Previous line’’ prediction, shown in Fig. 7, would be expected to be 


similar to previous value prediction, since a picture would presumably 


have approximately the same correlation vertically as it does horizon- 
tally. This would be the case except that our interlaced scanning system 
makes the previous line signal some 28 per cent further away from So o 
than the closest horizontal sample, S; 9. The error signal, e, is given by 
where 7’ is a line time. The error output has a maximum peak amplitude 
of twice the input. 


€ = Soo — Soa 


The filter characteristic can be expressed as 
: " ® wT 
7 on 7-5 
F(w) = | 2sin Tr) .4 2) 


Sp = 2519 -S20 





e= Soo- 2510 + S2,0 











TIME 
Fig. 6- Example of ‘“‘slope’’ prediction. Here the next signal value is assumed 
to lie On a straight line that intersects the two previous signal values. 
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Planar” prediction, shown in Fig. 8, is effectively tandem operation 
of “previous value” and “previous line” prediction. Planar prediction 
may also be thought of as the value represented by a plane above the 
present value of the signal when passed through three adjacent signal 


PREVIOUS LINE PREDICTION 








e 
Fig. 7—Example of ‘“‘previous line’’ prediction. Here the error signal is the 


difference between the actual value of the signal and the value of the signal on 
the line directly above 


PL ANAR PREDICTION 
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Fig. 8—An example of * planar’ 


prediction. Here the prediction is represented 
by a plane that has been passed through three adjacent signal values. 
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values, namely S;»9, So. and S;... The predicted signal is given by 


The filter characteristic 1s given by 


: . wor. wil” (e-< tr 
E(w) } sin sin 
2 2 
The peak error amplitude for “Planar” prediction can be four times 
that of the input. signal. 


“Planar” prediction has several good characteristics. For example, 


if Sy, andwS; 9 were white and So, black, then Spo would be predicted 
to be black. Thus a change horizontally from white to black would 
produce no errors. Similary, if S;., and So.. were white and S, 6 black, 
then Sy» would be predicted to be black. This indicates that a change 
vertically from white to black would be predicted correctly. In this 
manner, all vertical and horizontal contours in a picture are deleted. This 
philosophy can be extended to include other directions as well. 
“Circular” prediction, illustrated in Fig. 9, is an extension of planar, 
since it deletes horizontal, vertical and 52° contours as well. A total of 
190.5 microseconds of delay is required, making the required equipment 
more elaborate. Also, as more delay is required, more noise is added. 








>» INTERLACED 
FIELD 








Fig. 9 Past signal samples required for ‘‘eireular prediction’’—a type of 
prediction which removes horizontal, vertical, and +52° straight line picture 
contours 





LINEAR PREDICTION IN) TELEVISION 


Therefore, indefinite extension of this straight line contour deleting 
philosophy is rot a paying means of prediction, at least not at the present 
state of the art of wide band delay lines. Furthermore, the increasing 
diameter of the circle for extension of circular prediction would decrease 
its accuracy for finely concentrated detail. 

Fig. 10 shows the relative position of picture elements nearest Sp 
if a wide band field delay were available. The methods of prediction dis- 








—, x se INTERLACED FIELO 
1,0 0,0 “ 


‘ 
TES Te ee © 


Fig. 10—Small portion of television raster showing signal samples, including 
those of previous field, which would enable time extrapolation-space interpolation 
as a method of prediction 
cussed have been essentially an extrapolation in space; however, with a 
field delay, interpolation in space, and extrapolation in time would also 
be possible. 


EXPERIMENTAL CIRCUITRY 


Kxperimentally, those types of predictors that involve only a few 
Nyquist intervals of delay are easiest to mechanize. Fig. 11 shows a 
simplified schematic of a decorrelator that enables an evaluation of 


z 


linear prediction schemes having error signals given by ¢ M,050,0 2 
A, 051.0 & d2oS2o. This enables an evaluation of ‘previous value” and 
“slope” prediction. The signal is fed into a terminated delay line having 
taps at Nyquist intervals. Each of these signals is individually attenuated 
by the potentiometers in the cathode circuit of the cathode followers. 
Kach output is then fed to its respective polarity switch. The D.P.D.T. 
switch determines to which side of the differential amplifier, Vy, the 
particular signal is sent. Since more than one signal may require the 
same polarity, the signals are combined through “L” type resistance 
attenuators to prevent interaction between signals. The D.P.D.T. 
switches are so arranged that the other signals are unaffected when a 
polarity switch is reversed. The differential amplifier, V4, is a cathode 
coupled circuit having the advantage of two identical grids which pro- 
duce opposing effects in the output. The output is then matched to the 
line by the cathode follower, V5. In this way we can transmit (1) the 
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original picture signal with either polarity and any amplitude, (2) the 
picture signal delayed by one or two Nyquist intervals with either 
polarity and any amplitude or (3) any linear combination of (1) or (2). 

Fig. 12 isa block diagram of the experimental set-up used to investi- 
gate prediction methods that involve previous value and previous line 


samples such as “‘planar,” etc. The input is fed into a manually variable 


delay having 0.1 Nyquist interval steps. This delay line acts like a 
vernier for the 63.5 microsecond line delay. Effectively, it enables the 
previous line samples to be positioned directly above the previous value 
samples. 

The 63.5 microsecond delay is a so-called ‘“‘acoustic”’ or ‘“‘ultrasonic”’ 
delay line and was developed by Mr. H. J. McSkimin. The associated 
circuitry was developed by Mr. A. L. Hopper.* Storage is accomplished 
by a fused silica bar with quartz transducers operating at a carrier 


IN 
I 





POLARITY 
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Fig. 11—Simplified schematic for ‘previous value” and “‘slope”’ prediction. 


* A. L. Hopper, ‘“‘Storing Video Information,”’ Electronics, 24, pp. 122-125, June, 
1951 
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YIAGRANM OF EXPERIMENTAL 
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Fig. 12—Block diagram of experimental apparatus used to investigate methods 


of prediction involving combinations of previous signal values along a line with 
those on the line directly above. 





frequency of 54.0 me. The over-all video bandwidth is flat (+ 0.1 db) to 
5.0 me. Nonlinear distortion is approximately one percent when the 
peak-to-peak signal to r.m.s. noise is 58 db. To give an idea of its com- 
plexity, two such units with their associated power supplies require a 


seven-foot relay rack for housing. The signal at J; represents the input 
picture signal, even though it may be delayed by a small fraction of a 
Nyquist interval from the actual input signal. The signal at J» is the 


same signal as found at J; but delayed by one line time. Each of these 
signals is fed into terminated delay lines to enable additional signal 
samples to be obtained. The geometrical location of these signal sam- 
ples is illustrated in the upper right section of Fig. 12. Here, six signals 
are obtained instead of three as were required for “previous value” and 
“slope”’ prediction. These signals are weighted and polarized in the same 
manner as the three signals shown in Fig. 11. The output is the sum of 
these weighted signals and is given by 


e = Qo ,00 ot Ay 01.0 tT Qs pe 0 tT Ag So. rT ay iS; 1T Ge ve ew 


The coefficients may assume positive or negative values. 


MEASUREMENTS 


It is obvious that if we are able to predict the value of most signal 
samples closely (which we will be able to do if there is.a large amount of 
correlation in the picture), then the average amplitude of our mistakes 
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vill be much less than the average amplitude of the original signal. 


Thus, by using the decorrelator alone, we 


‘an send a message over a 
channel with the same bandwidth as before but with less average power. 
\t first, this might sound like a worthwhile saving; however this lower 
average power is accompanied by an even higher peak amplitude which 
makes any direct saving less attractive. Furthermore, the low frequency 
attentuation of the decorrelator makes the signal vulnerable to low 
frequency disturbances, since the correlator must restore (emphasize) 
these low trequency components 

\ prope! but not entirely ade quate method of evaluating the effective- 
ness of a predictor is by measuring the ratio of signal power to error 
power. This is called “Power Reduction” and is generally expressed in 
db. Power reduction simply provides a scale by which we can weigh a 
linear predictor’s capabilities. The “not entirely adequate” refers to 
the facet that minimum error power may not provide simultaneously the 
lowest amount of redundancy for that given type ol prediction. 

\s an example, Fig. 13 shows the power reduction for the relative 
weighting of the previous horizontal signal sample as compared to the 
present value of the signal, for three pictures later to be deseribed as 
Scene A, Band ©. The top-most curve is for Scene B, which is a 
simple, soft picture that contains very little detail. For this picture, 
the minimum error power coincides (within measurable limits) with the 
minimum redundancy. For Scene A and particularly Scene C, mini- 
mum error power is considerably different than that for minimum re- 
dundaney. This difference between minimum error power and minimum 
redundancy also apples to decorrelators using other types ot predictors 
as well. Minimum redundancy may also be a misleading criterion of a 
predictor’s performance, since the value of the prediction must depend 
on the particular type ol encoder used, and some types of encoding will 
require certain types of redundant information to be retained 

Phe following pictures are representations of the error signal as photo- 
graphed from a lO-inch laboratory monitor. The signals were band 
limited to 4.3 me. Fig. 14 represents the “original” for three scenes called 
\, Band ©. These pictures represent, to a first approximation, the 
gamut of pictures normally expected to be transmitted. They are by 
no means the best or the worst pictures than can be imagined; how- 
ever any system should be able to reproduce these pictures without 
appreciable distortion. For example, Scene C should be capable of 
being sent continuously without the elastic delay running out, ete. 

Fig. 15 shows how the error signal appears for ‘previous value” pre- 


ranT tion ‘Previous value” prediction Is excellent for flat white or dark 
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SCENE “A” 


POWER REDUCTION IN DECIBELS 
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hig 13 Power reduction for various weighting coefficients 
horizontal sample 


areas as can be observed in the background of Scene A. Where the 
separation of a white to black area is made, the error signal is large. It 
is this large error signal that informs the receiver of this change in bright 
ness, and until another change occurs, the error output is again zero. This 
type of performance produced the flat grey appearance of the back 
ground. In this way, the picture represents only changes in brightness 

a first difference type of picture. 

It may be noted that horizontal contour lines have vanished leaving 
only vertical contours which pertain to the brightness changes that 
have occurred. This effect is especially evident in Scene C. The 
power reductions given in the lower left hand corner of these pictures 
are consistent with their complexity. 

Fig. 16 shows the error signal appearance for “slope” prediction 
When compared to the error signal for “previous value’ prediction 
a finer vertical granularity is observed, and this is attributed to sudden 
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Fig. 14 -Three pictures as photographed from the face of a kinescope. Scene 
“A” is a picture of average complexity. Scene ‘‘B’’ is a simple, rather soft picture. 
Seene “C’’ is a complex, highly detailed picture. Roughly, these pictures represent 


the gamut of pictures normally expected to be transmitted. 
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Fig. 15—Three pictures showing the appearance of the error signal when using 
‘previous value”? prediction. Note the absence of horizontal contours. 
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Fig 17—-Three pietures showing the appearance of the error signal when usInNg 
‘previous line’’ prediction. Note the absence of vertical contours 
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hig. IS -Three pictures showing the appearance of the error signal when using 
- I PP 
‘planar’? prediction. Note the absence of horizontal and vertical contours. 
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changes in brightness. In the case of “‘previous value” prediction a sudden 
change in brightness produces only one error, where for “slope,’’ two 
errors result. This, to some extent, accounts for the lesser amount of 
power reduction measured for these scenes. 

Fig. 17 shows the appearance of the error signal for “previous line” 
prediction in the three scenes. Where vertical contour lines are pre- 
dominately left after “previous value” prediction shown in Fig. 15, 
horizontal contours, are more prevalent now. It can be noted that the 
power reduction for ‘previous line” prediction is less than that for “pre- 
vious value” prediction. This is due principally to the increased distance 
of the previous line sample from Soo. If the closest horizontal sample 
was taken at the same distance from the present value of the signal as 
the previous line sample, then the power reduction using these signal] 
values individually for prediction would be essentially the same for most 
pictures. 

Fig. 18 shows the error signal appearance for ‘“‘planar’’ prediction. 
Here, vertical as well as horizontal contours are deleted. In Scene A 
the tree trunk has almost completely vanished. In Scene B the picture 
has an extremely flat appearance. Scene C exhibits the lack of hori 
zontal and vertical contours best, since only sloping contours are left 
The power reduction figures at the lower left hand corner also show values 
for minimum error power. For most pictures, the error power can be 


reduced by a factor of one-half again over the planar coefficients by 


modifying the weighting coefficients. The coefficients for this modified 
planar case are given by 

' 20 oT. 
S = 31,0 t a) 


eG 
~ "p S11 


0.1 x 3 
These coefficients generally produce an error signal with less power than 
the coefficients used for ‘‘planar”’ prediction. 

While all pictures contain redundancy, the error signals from these 
simple linear predictors shown in Figs. 15, 16, 17 and 18 can visually 
be noted still to contain large amounts of redundancy. The contours of 
the models and of the various objects are readily identifiable. Were all 
redundancy removed, the picture would be completely chaotic and would 
appear very much like random noise, although greater efficiency in 
transmission would be achieved. For richer rewards, more sophisticated 
methods of prediction will be required. 
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Generalized Telegraphist’s Equations for 
Waveguides 


By S.A. SCHELKUNOFE 
(Manuseript received April 30, 1952) 


In this paper Maxwell’s partial differential equations and the boundary 
conditions for waveguides filled with a heterogeneous and non-isotropic 
medium are converted into an infinite system of ordinary differential equa- 
tions. This system represents a generalization of “telegraphist’s equations”’ 
for a single mode transmission to the case of multiple mode transmission. 
A similar set of equations is obtained for spherical waves. Although such 
generalized telegraphist’s equations are very complicated, it is very likely 
that useful results can be obtained by an appropriate modal analysis. 

From a purely mathematical point of view the problem of electro- 
magnetic Wave propagation inside a metal waveguide reduces to obtain- 
ing that solution of Maxwell’s equations which satisfies certain boundary 
conditions along the waveguide and certain terminal conditions at the 
ends of the waveguide. If the medium inside the waveguide is homo- 
geneous and isotropic and if the cross-section of the waveguide is either 
rectangular or circular or elliptic, the desired solution is obtained by the 
method of separating the variables. The method works for some other 
special cross-sections. It works also if the medium inside a rectangular 
waveguide consists of homogeneous, isotropic strata parallel to one of 
its faces. Similarly, it works if the medium inside a circular waveguide 
consists of coaxial, homogeneous, isotropic layers. But in general if the 
medium is either nonhomogeneous or non-isotropic or both, the method 
does not work, The mathematical reason for this is that the solution is 
of a more complicated form than a simple production of functions, each 
depending on a single coordinate. Any function that one usually en- 
counters in physical problems, and therefore a solution of Maxwell’s 
equations, may be expanded in a series of orthogonal functions. Sets of 
such functions are provided by the solutions for waveguides filled with 
homogeneous media. Such functions already satisfy the proper boundary 
conditions and the problem is to obtain series which also. satisfy 
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Maxwell’s equations. From the physical point of view this method 
represents a conversion of Maxwell’s equations into generalized ‘‘tele- 
graphist’s equations.” 

Thus it is already known that Maxwell’s partial differential equations 
and the boundary conditions along a waveguide are convertible into a 
set of independent ordinary differential equations, each resembling tele- 
graphist’s equations for electric transmission lines.’ Each equation de- 
scribes a ‘mode of propagation” in terms of concepts well known in 
electric circuit theory. A waveguide can be considered as an infinite 
system of transmission lines. If the medium inside the waveguide is 
homogeneous and isotropic and if the surface impedance of the boundary 
is zero, the method of separating the variables enables us to obtain a set 
of “normal’’, that is, uncoupled modes of propagation. Any irregularity 
or “discontinuity” in the waveguide provides a coupling between 
some, or all, modes of propagation. The irregularity may be in a boundary 
of the waveguide or in the dielectric within it. A heterogeneous dielectric 
may be considered as a homogeneous dielectric with distributed irregu- 
larities.” Similarly a heterogeneous non-isotropie dielectric may be con 
sidered as a homogeneous isotropic dielectric with distributed irregu- 
larities. Such irregularities provide a distributed coupling between the 
various modes appropriate to homogeneous isotropic Waveguides. Our 
problem is to calculate the coupling coefficients. The generalized tele- 
graphist’s equations, obtained in this manner, are very complicated in 
that they represent an infinite number of coupled transmission modes. 
They are useful, however, in suggesting a physical picture of wave 
propagation under complicated conditions, and can be used in approxi- 
mate analysis when we can ignore all but the most tightly coupled 
modes. For example, this picture was successfully employed by Alber- 


sheim® in studying the effect of gentle bending of a waveguide on propa- 


gation of circular electric waves. In this case it was important to consider 
the coupling between only two modes, TH: and TMy , which have the 
same cutoff frequency in a straight waveguide. More recently, Stevenson 
obtained exact equations for waves in horns of arbitrary shape.’ His 
equations express the propagation of the axial components of and H. 
The various modes are coupled through the boundary of the horn. In 


1S. A. Schelkunoff, ‘‘Transmission Theory of Plane Electromagnetic Waves,”’ 
Proc. Inst. Radio Engrs., Nov. 1937, pp. 1457-1492 

2S. A. Schelkunoff, ‘‘Klectromagnetie Waves,’ D. van Nostrand Co., (1943), 
pp. 92-93 

»W. J. Albersheim, “Propagation of Tk», Waves in Curved Waveguides,”’ 
Bell Sustem Tech. J., Jan. 1949, pp. 1-32 

‘A. F. Stevenson, ‘‘General Theory of Electromagnetic Horns,’’ J. Appl 
Phys., Dee. 1951, pp. 1447-1460. 
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the present paper we shall consider waveguides of constant cross-section 
and conical horns of arbitrary shape filled with a heterogeneous and 
non-isotropic dielectric and derive the equations for propagation of the 
generalized voltages and currents representing the transverse field com- 
ponents. The various modes are coupled through the medium. It is very 
likely that our equations can be generalized to include the coupling 
through the boundary. 

‘To understand the mechanism of coupling between the various modes 
through the medium consider Maxwell’s equations 


curl jw, curl H = °J + jad, (1) 


where “J is the density of conduction current while the other letter 
symbols have the usual meanings. In the most general linear case the 
components of B and D are linear functions of the components of H 
and FE respectively, with the coefficients depending on the coordinates. 
These equations can always be rewritten as follows 


curl EB joull M, curl H = jwel + J, (2) 


where .M and J are the densities of magnetic and electric polarization 


currents 


Ve = jo(B — ull), J =‘J + juo(D — ek), (3) 


/ 


and p, € are constants (not necessarily those of vacuum). If M and J 
were given, they would act as sources exciting various modes of propa- 
gation in a homogeneous, isotropic waveguide. If MW and J are functions 
of 17 and FE, they can still be considered as the sources, acting on power 
borrowed from the wave, of the various modes. Thus VW and J will 
provide the coupling between the modes existing in a homogeneous, 
isotropic waveguide. 

Thus in order to derive the generalized telegraphist’s equations we 
shall first consider the various modes of propagation in a homogeneous 
isotropic wave guide. Each mode is described by a transverse field distri- 
bution pattern’ 7'(u, v), where w and v are orthogonal coordinates of a 
point ina typical cross-section. This function is a solution of the follow- 


ing two-dimensional partial differential equation 


= | 0 fe. dT 9 aT San 
sre 1 [9 (@) 4, 2 (0) en, 
eye Ou \e; Ou Ov \@s Ov 


see Reference 2 
®s. A. Schelkunoff, “Electromagnetic Waves,’’ D. van Nostrand Co. (1943), 
{ hapter 10 
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where x is the separation constant and e, , é: are the scale factors in 
the expression for the elementary distance 


9 9 ‘ 9 
ds = e; du’ + e dv’. (5) 


In the case of TM waves the 7-function must vanish on the boundary 
of zero impedance. This boundary condition restricts x to a doubly in- 
finite set of values x,,, With the corresponding functions 7’... . In the 
case of TE waves the normal derivative of the 7-function must vanish 
on the boundary of zero impedance. Since we have to consider both 
types of waves simultaneously, we shall distinguish between them by 
enclosing the subscripts in parentheses for TM waves and in brackets 
for TE waves. The double subscript designation of various modes has 
been standardized only for rectangular and circular waveguides. For 
waveguides of other shapes the standard is to use a single subscript by 
arranging the modes in the order of their cutoff frequencies. For con- 
venience, we shall use this convention in the general case and denote 
TM modes by 7.)(u, v), and TE modes by 7;,;(u, v). The correspond- 
ing cutoff constants will be x.) and x;,). In what follows it is under- 
stood that whenever the T-functions should be designated by double 
subscripts, our single letter subscripts should be considered as symbols 
for ordered double subscripts. 

The transverse field components may be derived from the potential 
and stream functions,’ V and II for TM waves and U and © for TE 
waves. Thus 


E, = — grad V — flux ¥, iH, flux II grad UU, (6) 


where the components of the gradient and flux of a scalar function W 


are 


ow 


€, ou’ €» Ov 


ow 


grad, W = grad, W — 7 


, aw : aw 
flux, W = —., fu, FW = ~..., 
€y OV €; Ou 
The T-functions corresponding to the various modes of the same va- 
riety are orthogonal; that is, the following integrals over the cross-section 
vanish, 


| / yy dS = Q, | T (nj Tm AS = 0, if m x (&) 


It should be stressed that 7) and 7',,; are not, in general, orthogonal. 


7 See Reference 6. 
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Similarly the gradients of the 7-functions of the same variety as well as 
the fluxes, are orthogonal, 
[ (erad T »)):(grad Tym) dS = [} (flux T n(x Tomy) dS 


(9) 
| (grad 7',,;)- (grad Tim) dS I| (flux 7\,))-(flux T),;) dS = 0, 


ifm # n. The following gradients and fluxes of the 7'-functions are ortho- 


gonal for all m and n, 


[] (arad Tn))- (flux Tmy) dS | erad T n)) (flux Tom) dS 


(10) 


“ 


[} (grad T ny) (flux Tom) dS = 0. 


On the other hand, grad 7',,,; and flux 7); are not, in general, orthogonal. 
If all modes are present, the potential and stream functions are 


V - V n)(z)T mm) (U, v), HW = —IJa)(z)T (u,v), 
. (11) 
V V inp (2) Tn (Us, v), U = —ITnj(z)T {nj (u, v), 


where the tensor summation convention is used: whenever the same 
letter subseript is used in a product, it should receive all values in a 
given set and the resulting products should be added. The negative 
signs have been inserted in order to avoid a preponderance of negative 
signs in later equations. Substituting in (9), we have 

BE, = Vin) grad Tiny + Venj flux Tynj , 

H, = Tiny flux Tony + Tp grad Ty) - 


(12) 


The 7-funetions for the various modes are determined by equation 
(4) and the boundary conditions except for arbitrary factors related to 
the power levels of the modes. If we choose these constants in such a 


way that 


I} (grad T)-(grad T) dS = x? | T’ dS = 1, (13) 


then the complex power carried by the wave is given by an expression 


similar to that in an ordinary transmission line, 


P = §V caylee) + BV tail 


(14) 
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Hence, the V's and /’s correspond to the voltages and currents in coupled 
transmission lines. 
In an expanded form equations (12) are 
aT’ 
€, Ou 
aT 
€, OU i €, Ou 
To these we add the following expansions for the longitudinal compo 
nents of Band H 
Be = Xu V2.2) Tim, ¥), I XI» a(2)T i, ,v). (16) 
Kquations of this form satisfy automatically the boundary conditions 
on FE, and H, . The multipliers x, have been inserted arbitrarily in order 
to make the physical dimensions of the second factors to correspond to 
those of voltage and current. 
Let us now write Maxwell’s equations in an expanded form 


Ok Ok OH OH 


- Job 9 : 
Oz Co OV Oz 


P . JoD, ’ 
> OV 
on. OH jwD (17) 


ey ou 


OR ; OK 


O2 ) Ou 


Jw0B 
O02 


ek, O(eoH ) O(e.H,,) 
> jue 1¢ D 


O(eck,) 
- J wey B 


au ov Ou Ov 


Substituting from (15) and (16) in the left column of (17), we find 


aV ny OT dV, oT 
dz @.01 dz @ 


dV, oT. dV, OT’, 
jw, , (19) 
dz , €s OV F 


eT . ; 3 ve av’ a! y rT 
Ou Ov m™ au e; Ou " av du 


In view of (4) the last equation reduces to 


V a Tu joB 
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Multiplying (18) by | OT (m)/ €2 Ov) dS, (19) by [aT m)/ @1 dul ds, adding, 


and integrating over the cross-section, we obtain 


, LV tm ° r AT m OT im) 
X¢m) Vem + = 7W) I/ (2. ——B ; a) dS. (22) 
dz ae €. OV €; OU ; 


In the first term the summation convention should be ignored. Multiply- 
ing (18) by [07 ),)/e: dul dS, (19) by [AT ) 3 /e2 dv] dS, adding, and in- 


tegrating we find 


OV im ~ ffl 8Tim IT tm) , 
= —jw || (2. int 4p, ‘yas, (23) 
dz "a €; Ou 2 OV 


Multiplying (21) by 7. dS and integrating, we have 


Tus ™ | B.T im dS. (24) 


Subjecting the right column of (17) to a similar treatment, we obtain 


three additional equations. Summarizing, we have 


OV, ,. ae OT tm om ; ; 
jw | (4. : :* ) as + vesVemn, (4) 


dz €. OV €; Ou 
OL, . i OT (m IT my \ 0 , 
= — JW I| (0. “ — + D : ) ds, (26) 
dz " Ge e; Ou C2 OV 
dV» if IT tm) IT imi \ ac 7 
_—* I] (2. >} ho Vas, (27) 
dz yaad e€; Ou €2 OV 
AT im i OT tm) IT | m} ' 
Jw I| ( dD, ——- abe : - as -f Xm)! tits ‘ee 
d2 J. C) Ov é; ou ; 


Tim) = —jJw [[D.7.. dS. (29) 


In the last terms of equations (25) and (28) the summation convention 
should be ignored. 

If the components of B and D are linear functions of the components 
of Hf and F respectively, then with the aid of (15) and (16) they can be 
expressed as linear funetions of Vy, sae nl > li, : Tiny Vite ‘ Datel 
Solving (29) for Ve.) and /.),) and making the appropriate substitu- 


tions in (25), (26), (27), (28), we obtain the generalized telegraphist’s 
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equations in the following form 
dV cm) 
dz 
AT ¢m) 

dz 
AV tm) 
dz 
AT my 
dz 


os — Zim nl a oo Z (my nj ln} 


w = Fy 


il 


— Vim Ving = Yimin Vow 


The transfer impedances Z, the transfer admittances ¥, the voltage 
transfer coefficients ‘7’, and the current transfer coefficients ‘7’ between 
various modes are in general functions of z. They are constants if the 
properties of the waveguide are independent of the distance along it; 
in this case the problem of solving the generalized telegraphist’s equa- 
tions reduces to solving an infinite system of linear algebraic equations 
and the corresponding characteristic equation. 

Similar equations may be derived for spherical waves either in an un- 
limited medium or in a medium bounded by a perfectly conducting coni- 
cal surface of arbitrary cross-section. If the latter is circular and if the 
flare angle is 180°, we have a plane boundary. Hence, the case of spheri- 
cal waves in a non-homogeneous medium is included. In the spherical 
case we shall use the general orthogonal system of coordinates (r, u, v) 
where r is the distance from the center and (u, v) are orthogonal angular 
coordinates. In this system the elements of length ds and area dS are 
given by 


ds’ = dr’ + r(ei du’ + e: de’), dS = rdQ, dQ = ee, dudv. (31) 


The transverse field components may be expressed in a form similar 
to that for waveguides 
rE, = — grad V — flux II, rH, = flux Il — grad U, (32) 
where grad and flux of a typical scalar function are defined by equations 
(10). Instead of (11) we have 
V = V ony (rT) T ny (tu, v), -Tny(r)T my (u, v), 
(33) 
YW = —V,,)(r)T 4 (u, v), [ = Tiny“) T py (4, v), 


where the 7-functions satisfy equation (4) and appropriate boundary 
conditions. These functions, their gradients and fluxes are orthogonal 
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They are assumed to be normalized as follows 


| (grad 7)-(grad T) dQ = x” | T’dQ=1, (34) 


where dQ is an elementary solid angle. Hence, equation (14) will again 
represent the complex power flow in the direction of propagation. 
The various field components may then be expressed as follows 


OT) , vy _ OT i ; ee » Te 


€, Ou ~~ 6 € OV ~” @, OU 


rh; 


oT’, OT’, OT OT 1m, (35) 
ri  . H, Pipsich Pipicd ~ I a 
, ov 


C2 €; Ou 


rH, m= Xia) I y.tal T tn) . 


It should be noted that the physical dimensions of V;,,.., and /,,;,) are 
not those of voltage and current. Substituting in Maxwell’s equations 
and using transformations similar to those in the case of plane waves, 


we find 


aV.. wd 97... y ioe aoe 
) ; ” rb a7 ) ae +- X(m)yl : ¥ nde 


dr ie 9 OD e, au 


IT im 
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> OV 
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eC, Ou 
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') dQ t X{mj" “Evitel ’ 


dQ, lim) = —joo I (r°D,)T om AQ. 


Returning to the plane wave case and assuming the following general 


linear relations 
udlt as ; sulin + €uclly + €uck: , 
u,-H 


H 
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Substituting from equations (38) into equations (25) 
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to (29) we ob- 
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If we solve the last two equations for J. ;,.; and V,.) and substitute 
in the preceding four equations, we shall obtain the telegraphist’s equa 
tions in their final form (30). Thus, let 


+ 


“Zimi{n} = [| Jopme2X tn} Pn) T my AS, 


ve 


fe | JettesxcnyT (ny T cm GS. 
From these coefficients we obtain another set 
Zinitm normalized co-factor of *Zymy,, 
normalized co-factor of *Y cnc, 
Then, 
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Before substituting in equations (39) to (42), the summation index m 
in (47) should be changed to avoid conflict with m in the former equa 
tions. It does not seem necessary to make these final substitutions in 
their most general form. The results are very complicated and in prac 
tice the various coefficients are not independent. Some coefficients may 
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vanish; others may be small. In isotropic media, pus = boo = Me: 

UL. €, é e., = e and the mutual coefficients vanish. In gyromag- 
netic media subjected to a strong magnetic field in the z-direction, the 
permeability coefficients of superposed ac fields are’ 


LU ps Lt, u Migs Mass mv = fue = 0. (48) 


It the entire waveguide is filled with such a medium, assumed to be 


homogeneous, equations (43) and (44) become 


jmexin ff PraTim dS 


; (49) 
JWEX (7 | a task tes Lim 


ve 


In view of the orthogonality of the 7-functions and the normalization 


conditions (13), we have 


. Ais (50) 


Jwu = Jwe 


where the summation convention is waived. In this case all the transfer 


coefhicients in equations (30) vanish, 


i t Ga < “Ti. ; ‘rep Fé = “T ni (51) 


Phe transter impedances and admittances are 


Lim 0, ifn ¥ m, 
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0, all m,n; (52) 
JOM, I| ) ; of Sa of a ao | a dv, ifn # m, 
Je a Ou Ou Ov 
jou, if n m; 
‘CL. Hogan, The Ferromagnetic Faraday Effect at Microwave Frequencies 


ind Its Appleations The Microwave Gyrator, Bell System Tech. J., Jan. 1952, 
p.v 
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We note that Z omjjnj Zinjim) 5 Zl mI {n} Zinjim), (nh #m 
In rectangular waveguides we choose cartesian coordinates 
then e; Cy l, u xX,v y and 
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= (0, ifs = porg = t, but not if s pandq = t, 


= JOH, if s = Pp and q=t. 
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Some of the mutual impedances vanish; thus 


Zipoten = 0, 


Pq 
i] either »>+ S Or + f[ Is even. If > + 8, aS well as g + ‘ is odd, 
/ { I d 


$l iglatJwmeypgl(s a)’ + (t, b)*} 


Zi ; 7. oe 
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Similarly 

Zi paltetl 0, (57) 
if vither p + sor q + tis even, provided p ¥ sand q # t. If p + s, as 
well Hs q + t. IS odd, 


Z - lpgla(pe os q 8 )jwpzy (58) 


XpuXee(8? — p*)(q? — P)ab- 

Consider now the set of modes which includes TE,). This set in- 
cludes TFyo,, modes and all the other modes which are coupled to either 
of these modes. Noting that there are no TM, and TM 4) modes, we 
obtain the following table in which those modes which do not belong 


to the set are marked with a bar: 


, TEjos} , TMeay , TMay , 
» TE yoy » TM) , TMey , TMas 


Krom the preceding equations we obtain the coupling impedances, 
5 Jens » Zou = ~ 4 Joby ; 
T 
Z 01) (03) = Z (03) (01) = (), 
8 
or 
8V2 


= joue,[1 + 4(b/a)*) 
3r° 


Ziroj}(03) = —Zios)00) = 


2 JOUzy ’ 
Sy S) 
or 


Zion) = Zryion = 9, 


jwmeyl! + i(a/b)*)"", 


6 P 9 9 
; \ — jwusyl4 + (a/b)*| . a 
or 





GENERALIZED TELEGRAPHIST’S EQUATIONS 


l6Y 2 


3r° 


jopald + (b/a)y 


Zin * Z coryct = U. 


The principal effect of the gvromagnetic medium on the TE); and TE jo 
modes may be understood by taking into account their mutual coupling 
but ignoring their coupling to other modes. The equations of propaga- 
tion become 

dV 10] 
A» 


ue 


dl 10} = (ji t =) Via l> 
dz JOus20" 


AV (or 
dz 


dT pox) m Z 
— as (ju =~ ) V (on) - 
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For exponentially propagated waves we have 


~ jeapsl x0) — jedttey(S/e°) Lien) , 


= jops,(8/r)I 0) — joul ory , 


(62) 


When the mutual permeability is zero, we have two independent modes 


whose phase constants are 


2\1/2 2\1/2 
2 Mr 2 Mr 7 
Bro = (« ME - ) 9 Bo. (« ue= .) ° (63) 
M.A LU: h 


The phase constants of the perturbed modes may be expressed in terms 
of the unperturbed constants and the coefficient of coupling. When the 
losses are neglected, the mutual permeability is a pure imaginary. In 


this case it is convenient to define a real coupling coefficient 


JBuzy 
re 


Substituting from (62) in (61) and using (64), we find 


4 


BV 10) = wul yoy — joukT ory, 8Ino; = (w 


BV tor 








SO) rHE BELL SYSTEM TECHNICAL JOURNAL, JULY 1952 


Mliminating Vio) and Vio, , we have 


(o By )E (10) Biol or , 
sae ae — (66) 
(so Bi 1 ] i DkBorl p10) 
Multiplying term by term, we obtain the characteristic equation 
4 


BY — (Bin + BoB’ + (1 — k*) BiB = O. 


Solving, we have 


1 (Bio + Bor) + 4[(Bio —Bo1) + 4h Bi0801]"”. (68, 
} 


The effeet of coupling is to increase the larger phase constant and de- 
crease the smaller one; that is, to make the slower wave slower, and the 
faster Wave faster. 

Let us assume a > 6; then By > Bo. Taking the upper sign in (68) 
and substituting in the second equation of the set (66), we have 


] 01} qk(Bo Bio) . a l (2 fer) (G9) 
- = ) — ° ” 
10) ” *y (p* + k?)} . d 2 Box Bio 


From (65) and (69) we find 


Bio I Ol pk(Biro0 ‘Bor) 


7 (70) 
Boy To p+ (p? + ky)" ' 


Hence, the ratio of the power carried in the TE; mode to that in the 
TE); mode is 


o* 


Po Viol pon 


i 


— 71) 
Py Van T ho t (p? + e)iep Mf 


This ratio increases as / increases and p decreases. 
If the phase constants of the uncoupled modes are equal, then p = 0 
and Po, Py for all values of the coupling coefficient. In this case (68) 


becomes 
Biol l t hk ) or 8 = Bro( l = k)! = (72) 


In terms of the original constants, 


gS . . m 1/2 
g - Ibey we - ; 
w tes” 


Phe cutoff frequencies of both normal modes are seen to be independent 
of either the transverse permeability or the mutual permeability. Since 
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zy IS & pure imaginary, it effectively increases the transverse permeabil- 
itv for one mode and decreases it for the other. 

To evaluate the effect of higher order TE and TM modes on wave 
propagation we may substitute from (68) in all terms of the character- 


istic equation for telegraphist’s equations except the first two diagonal 
terms and recalculate the 3’s. Alternatively we may replace TE); and 


TEx modes by the normal modes just obtained, recalculate the cou 
pling coefficients, and evaluate the effect of the mode with the greatest 
coupling to the modes under consideration. 





Photoelectric Properties 


of loniecally Bombarded Silicon 


By EDWIN F. KINGSBURY and RUSSELL 8S. OHL 
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In the course of investigation of the rectifying properties of silicon very 
interesting photoelectric properties were found. The first photo-cells were cut 
from bulk silicon in which a natural potential barrier was found, A typical 
spectral characteristic of such a cell is shown. This early work was followed 
hy the discovery of the ionte bombardment method of producing photo active 
silicon surfaces. The effects of the temperature of the target and of the energy 
of the bombarding particles in the photoelectric properties ts illustrated by 
characteristic curves. Relative equi-energy spectral response characteristics as 
a function of wavele ngth are tllustrated. The photon efher ney as a function 


of wavelength of a typical cell ts shown. 


INTRODUCTION 


Because of the importance that barriers have come to assume in the 
general field of semiconductors the authors have been urged to publish 
results of their early experiments in this field. These experiments were 
undertaken in the course of a search for semiconductive material suitable 
for use as point contact rectifiers. 

sefore March 1941’ one of the writers discovered a well-defined bar- 
rier having a high degree of photovoltaic response. The barrier was found 
only in melts of some lots of commercially available high-purity silicon. 
Phis barrier showed a high photovoltaic sensitivity to radiation from 
incandescent lamps. 

The existence of this natural barrier was first observed in rods cut 
from melts for resistivity measurements. These rods showed a high de- 
gree of photovoltaic response, were found to have a high thermoelectric 
coefficient, and had good rectifying properties.’ The fact that one end 
of the rod developed a negative potential when illuminated or heated 
and that when supplied with a negative potential showed low resistance 
to current flow across the barrier led to the terminology of n-type 


SO2 
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silicon. The material of opposite type was named p-type. Material of 
the n-type is now known to derive its electrical properties from the 
presence in the crystal lattice of electron donor impurities, for example 
phosphorus, while p-type derives its electrical properties from the pres 

ence of electron acceptor impurities, such as boron. In this paper some 
of the results of investigations of the natural barrier are reported ; how 

ever, the photovoltaic properties of induced barriers obtained by the 
ionic bombardment of p-type silicon will be given more detail treatment. 


EARLY RESULTS 


The approximate location of the natural barrier found in early melts 


is shown in Fig. 1. The barrier was generally located in the melt per 


pendicular to the axis of the melting crucible or more accurately to the 
direction of the temperature gradient. Plates and rods containing sec 
tions of the photoactive barrier, Fig. la, were cut from the melt and 
mounted on convenient supports for laboratory tests. Fig. le shows a 
magnified section of one of these barriers.” 


Fig. | a) Drawing of melt showing position of photovoltaic barrier and photo 
cells with natural barrier. (b) Drawing of melt showing surface type photo cell 
made from natural barrier. (¢) Magnified, etched seetion of slowly cooled silicon 
showing the transition between p and n silicon forming the barrier which consists 
of intermeshed striae of these two varieties 





rHE BELL SYSTEM TECHNICAL JOURNAL, JULY 1952 


K-14 LIGHT 
Q)) source 





| _ BARRIER 


e315 on 


mmm s8 





a 














( 7 O08 O9 1.0 
WAVELENGTH IN MICRONS 








RESISTANCE 
































(c) 
Fig. 2a—Spectral response of internal barrier in silicon. 
Voltage and current photosensitivity of internal barrier in silicon. 
Rectification characteristic of internal barrier, dark and illuminated. 
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A typical spectral response curve of such a barrier is shown in Fig. 2a 
while Fig. 2b gives its open circuit voltage, short-circuit current and 
resistance when illuminated by a tunsten light of 2848°K color tempera 
ture. This cell resistance was taken as equal to that of an added series 
resistance which reduced the short-circuit: photocurrent to one-half. 
The value so obtained is somewhat higher than the corresponding ratio 
of the voltage and current given in the figure. Fig. 2e gives the behavior 
as a rectifier in the dark and with a stated light on the barrier. 

Cells whose barrier was near the surface were made by cutting close 
to the natural one as shown in Fig. 1b. This cut exposed large photoactive 
areas. Surface barrier activity was occasionally found on the top surface 
of some melts. These surface type cells showed a wider spectral response 
toward the visible than the internal barrier type. This was found to be 
due to the spectral absorption characteristics of the bulk silicon. A 
further discussion of this appears later in the paper. 

These early barrier cells showed remarkable stability under severe 
temperature conditions. For instance, they could be heated to redness 
in air and quenched in water with no serious change in their character- 
istics. They were tested in liquid nitrogen, under water and in oil without 
injury. They could be illuminated with direct sunlight with no injury 
to their response characteristics other than the temporary effect of the 
increased temperature. Several of these internal barrier cells have been 
in use in test circuits for more than ten years with no serious change in 
their photoresponse properties. These observations seemed to indicate 
clearly that a very high degree of stability could be expected from silicon 
photocells. 

However, there were serious practical disadvantages to the early 


cells. Those shown in Fig. la were active near the exposed barrier itself 


which was usually a strip along the surface about } mm wide. On the 
other hand, the surface types as shown in Fig. 1b showed irregular re 
sponsiveness over the surface area. 

From these early studies it was clear that if a good method could be 
found to activate large areas of silicon surfaces uniformly, cells could 
be made which might compete with other kinds of surface barrier type 
cells already available. The search for such a process resulted in the 
ionic bombardment method of activating silicon surfaces. Such surfaces 
also have desirable rectifying properties. 


METHOD OF PREPARATION 


Hyper-purity silicon was used for bombardment type cells to avoid 
the formation of natural barriers due to minute impurities and to give 
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better control of the sensitivity. After being cast in a fused silica crucible, 
the roughly cylindrical piece was ground to a cylinder about 13” di- 
ameter, a process which removed crucible contamination and gave a 
convenient size for slicing into wafers about 0.025” thick. The two faces 
were then made approximately flat and parallel after which one was left 
rough and the other ground and polished down to a good optical surface. 
In most cases the dises were then cleaned by soaking for approximately 
fifteen minutes in a solution of hydrofluoric acid, rinsed in distilled water 
and dried. 

The activation consisted of exposing the polished face to a uniform 
beam of positive ions of helium at a pressure of 10° to 10° mm of 


Fig. 3--Intermediate and large size photocells made by ion bombardment. Back 
of the intermediate also shown. 


mercury. The energy of the particles used in different units ranged from 
100 to 30,000 electron volts. During this bombardment the silicon surface 
was kept at a favorable temperature, about 395°C, 

After activation, collector ¢ lectrodes of evaporated rhodium were ap- 
plied. Cells of three sizes have been constructed, two of which are shown 
in Fig. 3, the intermediate and the large one, of exposed active areas 
about 0.40 and 8.0 sq. em. respectively. A small one had an area around 
0.005 sq. cm. Most of the measurements reported in this paper have 
been made with the intermediate size. 


EFFECT OF LON VELOCITY 


That ion velocity has a profound effect on the voltage current char- 


acteristic of bombarded surfaces is shown in Fig. 5. These characteristics 


were obtained by placing a tungsten point contact under 10 gm of force, 
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Fig. 5—Effect of bombardment voltage on the rectification of the intermediate 
cells. 
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Fig. 6—Photocurrent at a constant illuminance versus the bombarding voltage 


on the photo active surfaces of the medium size cells whose spectral 
response is given in Fig. 8. However, in order to show the rectifying prop- 
erty of the barrier without the complication of a point contact, a dise of 
hyper-purity silicon 13” in diameter and about 0.025” thick was given 
an optical polish on both faces. One face was bombarded with 30-kv ions. 
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Fig. 7--Photovoltage at a constant illumination versus temperature of the 
bombarded silicon surface 
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Fig. 8—Spectral response of the intermediate size cells at various bombarding 
voltages. 


Klectrodes 14” in diameter of evaporated rhodium metal were applied in 
like manner to each surface. Contact was made to the collector electrodes 
by means of tin dises. Fig. 4 gives the forward and backward log voltage- 
log current relation of this large cell. Without bombardment such an 
arrangement shows ohmic conductivity so it is evident that the treat- 
ment is responsible for the development of a potential barrier beneath 
the surface. It is believed from the high dark resistivity of the bom- 
barded layer that the intrinsic properties of the silicon are developed 
therein. Thus an intrinsic -p type potential barrier is produced similar 
to a degree to the n-p junction. One would expect the depth of this bar- 
rier to be related to the velocity of the ions. Consequently a study has 
been made of the effect of ion velocity on the photoelectric properties. 
The photoelectric current at constant illuminance for a series of cells 


prepared by bombardment with ions of different energies is shown in 


Fig. 6. It is remarkable how quickly and completely the current sensi- 
tivity saturates at approximately 500 volts. 
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EFFECT OF SURFACE TEMPERATURE DURING BOMBARDMENT 


In the preparation of photocells it was found that the surface tem- 
perature during bombardment had a pronounced effect on the efficiency. 
In order to study this effect it was necessary to determine the surface 
temperature of the silicon itself. Since it was impractical to measure the 
silicon temperature during bombardment, a calibration was made of the 


surface temperature in terms of the temperature of the graphite heating 


block. This calibration was carried out by two platinum/platinum 
rhodium thermocouples made of 5-mil wires. The fused thermojunction 
beads were held in contact with the surfaces by miniature tungsten 
springs. Temperature measurements with the thermojunction in contact 
with the silicon surface were subject to error from the slightest con- 
tamination at the point of contact. Perhaps the most difficulty was due 
to a reaction between the platinum and silicon at temperatures above 
400°C. 

The effect of surface temperature on the photoresponse is shown in 
Fig. 7. It is apparent that maximum sensitivity results when the target 
is kept at about 395°C. Perhaps by coincidence this is also the temper- 
ature at which no Hall Effect is observable in this hyper-pure material. 

Cells prepared at temperatures above the critical value show lower 
back resistances than those prepared at the critical temperature and 
conversely those at temperatures below the critical value have higher 
back resistances but a much reduced photoresponse. 


EFFECT OF TOTAL BOMBARDING CHARGE 


The photoresponsiveness improves as the total bombarding charge is 
increased until it has reached about 600 microcoulombs per sq. cm. 
Further bombardment produces no appreciable improvement. In certain 
exploratory tests a total charge of about 9000 microcoulombs at 30 kv 
has been applied. Under these severe conditions the surface may show 
small areas having a slightly etched appearance. 

No extensive tests have been made to determine the effect of the rate 
of application of the bombarding charge. The apparatus was designed 
for use at a rate of about 5 microamperes per sq. cm. It is known how- 
ever, that between the limits of about 2.5 and 10 microamperes per sq. 
cm. the effects are subject only to the total charge or the total number 
of ions which strike the silicon surface. 


EFFECT OF BOMBARDMENT VOLTAGE IN SPECTRAL RESPONSE 


Six spectral curves are shown in Fig. 8 which illustrate the result ob- 
tained with the intermediate size cells over the bombardment. voltage 
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range previously mentioned. The peak of the lowest voltage cell is 
definitely toward the blue compared with the other five whose maximum 
is constant at about 0.725 u. 

One objective in this study was to obtain evidence relating to the 


depth of the barrier below the silicon surface as a function of the energy 


of the bombarding particles. The higher the velocity of the particles the 
further beneath the surface one would expect the barrier to be located 
and as a result there might be a shift in the spectral characteristic toward 
the red with increasing depth of the barrier due to the relatively greater 
absorption at the blue end. There is however, a selective or secondary 
maximum at the peak which sharpens it and nullifies the effect of the 
warping of the entire curve. The blue to red shift can be shown as in 
Fig. 9 by plotting the ratio of the responses in Fig. 8 at 0.50 » and 1.0 gz. 
Thus at low voltage the blue to red ratio is high and decreases as the 
bombarding potential is raised. 

In the spectral curves it will be noted that there are a number of 
secondary humps located near the top of the curves and extending down 
on the blue side. There is a strong tendency for them to occur at definite 
wavelengths and to beevenly spaced regardless of the bombarding voltage. 
SPECTRAL MEASUREMENTS ON THE LARGE CELLS AND THE EFFECT OF 

MATERIAL COMPOSITION 

For the large cells, two grades of silicon were used both prepared by 

pyrolytic reduction of SiCl, and called “hyper-pure”’. These will be 


2.8; 
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Fig. 9—Ratio of blue to near infra-red response versus bombarding voltage 
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designated B and C, the former being from the same source as “silicon 
8” referred to in the paper by Scaff et al.” A typical analysis is given 
therein. The C silicon was from another source and a spectroscopic analy- 
sis indicated it was somewhat more impure than B thus agreeing with 
observed differences in its electrical and optical characteristics. An opti- 
eal variation of considerable interest is shown in Fig. 10 where the 
spectral transmittance of the two grades of silicon is compared in the 
infra-red for polished plates each 0.0195” thick. 

The transmittance of B decreases a little with increasing wavelength 
but C goes down much more. Both however, start to get transparent at 
about the same point, 1.1 ~@ and also show corresponding absorption 
bands superimposed on the main curve. Briggs’ has compared the trans- 
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Fig. 10—Spectral transmittance of B and C grades of silicon, polished plates, 
0.0195” thick 


mittance from 24 to 12 4 of the A and B silicons in Seaff’s paper where 
the former was much more impure than the C grade. The absorption 
of the A silicon increased so rapidly out in the infra-red that a much 
thinner sample was used for the measurements than for the B material. 
If this difference in thickness is allowed for, the effeet of impurity 1s 
very striking. 

The spectral response of large area cells made of the B and C materials 
and bombarded with 1000-volt helium positive ions is shown in Fig. 11. 
The two curves are similar in shape except the one for C silicon is some- 
What narrower and in addition is shifted toward the blue. Both have 
some of the secondary humps noted previously. 

All the cells shown in this paper have indicated a long wave limit of 
about 1.2 4. Actually some response can usually be detected out to about 
1.3 4. Measurements made some years ago on the internal barrier units 
also gave a limit around 1.3 ~ but relatively more response at 1.2 ~ with 
peaks close to 1.10 4. This difference is reasonable because light was 
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projected along the barrier plane and not normal to it as in the latest 
units, so that with the rapidly increasing transparency in this region, 


less infra-red radiation was lost. However, the blue was rapidly at- 


tenuated. 

When illuminated by tungsten light of 2848°K color temperature, the 
large B cells gave 2160 microamps per lumen and the C unit 638. Cor- 
recting for a surface reflectance of 0.385, the net sensitivities would be 
3510 and 1040. These measurements were made with between 4- and 
5-footcandles illuminance on the cells, a region in which the response is 
proportional to the intensity. At much higher values of illuminance there 
was some falling off of response so that the effective sensitivity was a 
little lower. The above measurements were made on a ten ohm microam- 
meter which is too low a resistance to affect the linearity. The inter- 
mediate cells ran approximately 3000 microamps per lumen in the most 
sensitive region of bombardment without correction for surface reflec- 
tion and at 10- to 20-footeandles for the same tungsten lamp using a 
meter of 76 ohms. 
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Fig. 11—Spectral response of large size photocells of B and C grades of silicon. 
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PHOTON EFFICIENCY 





It is of interest to examine the spectral photon efficiency of a cell made 
by bombardment. As an example, there may be taken the 3-kv cell 
whose spectral response is shown in Fig. 8. When illuminated by a tung- 
sten light of 2848°K color temperature at 10-foot candles, a sensitivity 
of 3090 microamps per lumen was secured. Allowing for a surface re- 
flectance loss of 0.385, this value becomes 5020 for the radiation actually 
absorbed. From these data the sensitivity in microamps per microwatt 
at the peak 0.725 u, calculates to be 0.388 and the photon efficiency, i.e., 
the electrons per photon, 0.66. Fig. 12 gives the efficiency through the 
spectrum. Note that the efficiency rises some on the short wave side 
shifting the peak of the equl-energy curve (Fig. 8) over to 0.625 u. This 
increase is evident from the fact that if the equi-energy curve decreased 
linearly from the peak at 0.725 uw to zero at 0 uw, the photon efficiency 
would remain constant and equal to that at 0.725 uw. For the purpose of 
the above calculation, the curve in Fig. 8 has been taken as going to zero 
at about 0.40 yw, a fact experimentally checked. If unity is considered to 
be the maximum possible efficiency at any wavelength, 72 per cent of it 
is attained at 0.625 w and nearly half of the spectral range is 50 per cent 
or higher. 
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Fig. 12 Spectral photon efficiency of the 3-kv cell of Fig. S. 
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CONCLUDING REMARKS 


These experiments have served not only to introduce us to some of the 


phenomena involved in semiconductor barriers but have also yielded 


photo cells having desirable properties. These cells have a high degree of 
stability and will stand treatment ruinous to most other cells. They have 
a very high current sensitivity to tungsten light and daylight. They re 
quire no associated battery and can be made in large areas. Unlike the 
material used in many types of photo cells, silicon does not have the 
disadvantage of scarcity. All tests to date indicate that an indefinitely 
long life may be expected even under extreme illumination. Fig. 11 sug- 
gests that it may be possible to control to some extent the spectral re 
sponse in the region from the deep blue into the infra-red. The long wave 
limit is set by the edge of the absorption characteristic. 
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Abstracts of Bell System Technical Papers* 
Not Published in This Journal 


Vechanical Properties of Discrete Polymer Molecules. W. ©. BAKER, 
W.P. Mason and J. H. Hetss’. J. Polymer Sev, 8, pp. 129-155, Feb., 
1952. (Monograph 1937). 


Post-War Achievements of Bell Laboratories: I, O. FE. BucKLEY'. 
Bell Tel. Mag., 30, No. 4, pp. 224-237, 1951-1952 


A Portable. Direct Reading Vicrowave Noise Generator. kK. L. CHIN- 
vock. Proc. Inst. Radio Engrs., 40, pp. 160-164, Feb., 1952. (Mono- 
graph 1039 

This paper discusses the factors which influenced the design of a direetly 
calibrated portable microwave noise source, utilizing a fluorescent lamp. The 
variation of the noise power output and the impedance match as a function of 
the operating temperature are considered, and the portable unit is described. 


The Quantum Theory. K. K. Darrow. Sei. Am., 186, pp. 47-54, 
Mar., 1952. (Monograph 1940). 

Concerning the early years of this fundamental concept of modern physics 
how Max Planck formulated it at the turn of the century and how others en- 


larged. it up to 1923. 


Performance of Ultrasonic Vitreous Silica Delay Lines. M.D. FAGAN’. 
Tele-Tech, 11, pp. 48-45, 1388+, Mar., 1952. (Monograph 1951). 

Results of tests at 10 and 60 me with resistive terminations of 75 to 1000 
ohms. Low terminating impedance values yield wide bands but involve higher 


msertion losses 


Phase Transition oO} \ DyDoPO, B 4 ie M \'l rHiAs. Phys. Rev., Vv. 85, 
) L41, Jan x 1952 


Keng neeriuig Local Te levision Facilities and Theor Operation. B. }). 


* Certain of these papers are available as Bell System Monographs and may 
he obtained on request to the Publication Department, Bell Telephone Labora- 
tories, Inc., 463 West Street, New York 14, N. Y. For papers available in this 
form, the monograph number is given in parentheses following the date of pub- 
heation, and this number should be given in all requests. 
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Wickuine’ and J. E. Farvey*. Elec. Eng., 71, pp. 252-257, Mar., 
1952. 

All the means of electrical communication are called into play when a city- 
wide coverage of an event is to be televised. How telephone and television facil- 
ities were utilized on the day that Chicago weleomed General MacArthur is 
explained in this article. 


Echo Distortion in the FM Transmission of Frequency-Division Mul- 
tipler. W J. Avpersnem’ and J. P. Scuarer’. Proc. Inst. Radio Engrs., 
40, pp. 316-328, March, 1952. 

The composite multiplex signals generated by frequency-division methods 
long standard in telephone communication can be transmitted by the new trans- 
continental broad-band FM radio relays. Signal intermodulation by echoes must 
be minimized, Such intermodulation is investigated in this paper experimentally 
and analytically. Two types of echoes are considered: (1) weak echoes with de- 
lays exceeding 0.1 microseconds, caused mainly by mismatched long lines; and 
(2) powerful echoes with delays shorter than 0.01 microseconds, caused by multi- 
path transmission, and leading to selective fading. By use of random noise sig- 
nals, the distortion is evaluated as a function of various parameters of the echo, 
the base-band, and the rf modulation. 


Motion of a Ferromagnetic Domain Wall in FesO4. J. K. Gaur". Phys 
Rev., 85, pp. 664-669, Feb. 15, 1952. 

ixperiments have been made on a sample of FesQO, cut from a single crystal 
in such a way that its ferromagnetic domain pattern includes an individual 
domain wall whose motion can be studied. This sample has a permeability which 
is high (about 5000) at low frequencies and drops off rapidly above L000 cycles 
A hysteresis loop and data on wall velocity vs applied field were also taken 
The data are discussed in terms of recent developments in the theory of the 
ferromagnetic domain wall. It appears that this theory explains our data satis- 
factorily, and that in using it to explain our data we determine some of the 
fundamental magnetic constants of Fes0,. We are also able to gain some insight 
into domain wall motion in ferrites generally in this way. 


The Drift Mobility of Electrons in Silicon. J. R. Haynes’ and W. C 
Westra’. Phys Rev., 85, p. 680, Feb. 15, 1952 


Formulas for the Group Sequential Sampling of Attributes. H. 
Jonrs*. Ann. Math. Statistics, 23, pp. 72-87, March, 1952. 


Some Fundamental Properties of Transmission Systems. F. B. 
LLEWELLYN’. Proc. Inst. Radio Engrs., 40, pp. 271-283, March, 
1952. 

The problem of the minimum loss in relation to the singing point is investi- 
gated for generalized transmission svstems that must be stable for any combina- 
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tion of passive terminating impedances. It is concluded that the loss may ap- 
proach zero db only in those cases where the image impedances seen at the ends 
1 


of the system are purely resistive. Moreover, in such cases, the method of over- 
coming the transmission loss, whether by conventional repeaters or by series and 


shunt negative impedance loading, or otherwise, is quite immaterial to the ex- 


ternal behavior of the system as long as the image impedances are not changed. 


rhe use of impedance-correcting networks provides one means of insuring that 
the phase of the image impedance of the over-all system approaches zero. Gen- 
eral relations are derived which connect the image impedance and the image 
gain of an active system with its over-all performance properties. 

= , , . 1 

The Arithmetic of Ménage Numbers. J. Riorpan. Duke Math. J1., 


19, pp. 27-30, March, 1952 


A Recurrence Relation for Three-Line Latin Rectangles. J. Riorpan’. 
tm. Math. Monthly, 69, pp. 159-162, March, 1952. 


Capacitors and Communications. Inductive Coordination of Lines. A. 
R. Waruner’ and W. E. Buorcksr’. Elec. Light and Power, 30, pp. 105 
108, 114, March, 1952. 

Although the use of eapacitors on power lines has been expanding, their use 
has caused relatively few cases of noise on communication lines and these have 
heen satisfactorily corrected. The causes of trouble and remedial measures were 
the subject of a recent, joint E.E.[.-Bell System study described here. 


Book Reviews 


ANTENNAS: THrory AND Practice. By Sergei A. Schelkunoff and 

Harald T. Friis, 689 + xxii pages, John Wiley and Sons, Inc., New York 
1952). Price: $10.00. 

This is a recent addition to Wiley’s Applied Mathematics Series edited by 
I. S. Sokolnikoff. It contains a thorough and balanced treatment of electro- 
magnetic radiation and electrical properties of various types of antennas. In 
these days of rapid expansion of microwave engineering it would have been easy 
to neglect the older and less glamorous long-wave and short-wave antennas. 

iuthors are to be congratulated on their impartiality. The exposition is 
lucid. While the entire quantitative theory of antennas is based on Maxwell's 
equations, unnecessary mathematics is conspicuous by its absence, and physical 
explanations are abundant. 

The book begins with a long chapter on Physical Principles of Radiation. 
Chis chapter is almost a book within the book. It touches upon the most impor- 
tant ideas and problems of antenna analysis and contains a number of simple 
but useful formulas. Cireuit and field concepts are compared, and the similari- 
ties as well as the differences between them are exhibited. Maxwell’s equations 
are stated in a form which is particularly easy to understand. In this form, one 
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equation expresses a relation between the average electric intensity tangential 
to a given curve and the time rate of change of the average magnetic intensity 
normal to a surface bounded by this curve. The other equation expresses a com- 
plementary relation. The reader will be impressed by a simple physical picture 
from which the authors are able to derive the expression for the radiation field 
of a short antenna. In this chapter they discuss the effect of heat loss and imped 
ance mismatch on the efficiency of antennas. Among other topics will be found di- 
rective radiation and reception, large antenna arrays, horns, reflectors, and lenses. 

After this extended general introduction a more detailed analysis of various 
problems begins. Chapter 2 is devoted to Maxwell's equations and Chapter 3 
to plane waves on conductors and in free space. The main topic in Chapter 4 
is the derivation of the expressions for the complete field surrounding a short 
antenna from Maxwell's equations. The authors have made a special effort to 
show the connection between this field and the oscillating charge in the antenna 

Applications of this basic theory begin with Chapter 5 devoted to directive 
radiation. This chapter is concerned with radiation patterns of various arrays 
and with calculation of radiated power. A novel method, the method of momonts 
(pp. 162-195), is likely to prove valuable when spatial distributions of antenna 
current are complicated (as in the case of shunt-fed antennas). Chapter 6 ex- 
plains methods for calculating directivites and effective areas of antennas 
Some ground effects are considered briefly in Chapter 7. In Chapter 8, the dis- 
cussion of current distributions in antennas made up of thin wires is particularly 
thorough. First, simple approximations are developed; then the effeets of var- 
ious factors are carefully examined. Various reciprocity and circuit equivalence 
theorems, so useful in antenna analysis, are collected in Chapter 9. 

Beginning with Chapter 10 the general theory is applied to specific antenna 
types. Thus, small antennas are treated in Chapter 10; quarter-wave, half-wave 
and full-wave antennas in Chapter 11; general dipole antennas in Chapters 12 
and 13; rhombic antennas in Chapter 14; miscellaneous types of wire antennas 
in Chapter 15; horn antennas in Chapter 16; slot antennas in Chapter 17; re- 
flectors in Chapter 18; and lenses in Chapter 19. 

Practical engineers will be delighted with the appendices which contain in a 
compact form some of the most useful information about transmission lines, 
dipole antennas, antenna arrays, optimum horns, and lenses. Teachers will 
welcome the numerous problems scattered throughout the book. 


ADVANCED ANTENNA THeEory. By Sergei A. Schelkunoff, 216 + xii 
pages, John Wiley and Sons, Inc., New York (1952). Price: $6.50. 

This book is a recent addition to Wiley’s Applied Mathematics Series edited 
by I. 8. Sokolnikoff. It is concerned with recent advances in antenna theory and 
is divided into six chapters. General expressions in spherical coordinates are 
derived for electromagnetic fields in free space and in the presence of conducting 
cones and thin wires diverging from a common point. In Chapter 2 these expres- 
sions are applied to dipole antennas, vee antennas, end-fed antennas, ete. Chap- 
ter 3 gives an account of Stratton and Chu’s theory of spheroidal antennas 
Integral equations in antenna theory and Hallen’s method of their solution are 
treated in Chapters 4 and 5. The book is concluded with a chapter on natural 
oscillations in antennas. A substantial number of problems and several interest- 
ing appendices will be found at the end. 
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